-- Logs begin at Fri 2022-08-12 11:06:06 UTC, end at Fri 2022-08-12 12:11:23 UTC. -- Aug 12 11:35:40.513051 dv-cinder-852828-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 12 11:35:40.520375 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 11:35:40 2022] *** Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: nodename: dv-cinder-852828-2-iscsi Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: machine: x86_64 Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: clock source: unix Aug 12 11:35:40.522385 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: pcre jit disabled Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: detected number of CPU cores: 4 Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: current working directory: / Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: detected binary path: /usr/bin/uwsgi-core Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: your processes number limit is 47680 Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: your memory page size is 4096 bytes Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: detected max file descriptor number: 2048 Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: lock engine: pthread robust mutexes Aug 12 11:35:40.522923 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: thunder lock: enabled Aug 12 11:35:40.523677 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 12 11:35:40.523796 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 11:35:40.563007 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: Python main interpreter initialized at 0x55d60e7b79c0 Aug 12 11:35:40.563007 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: python threads support enabled Aug 12 11:35:40.563007 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: your server socket listen backlog is limited to 100 connections Aug 12 11:35:40.563007 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: your mercy for graceful operations on workers is 90 seconds Aug 12 11:35:40.563395 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 11:35:40.563469 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: *** Operational MODE: preforking *** Aug 12 11:35:40.563701 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: *** uWSGI is running in multiple interpreter mode *** Aug 12 11:35:40.563701 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: spawned uWSGI master process (pid: 93170) Aug 12 11:35:40.563904 dv-cinder-852828-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 12 11:35:40.565520 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: spawned uWSGI worker 1 (pid: 93181, cores: 1) Aug 12 11:35:40.565520 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: spawned uWSGI worker 2 (pid: 93182, cores: 1) Aug 12 11:35:40.565520 dv-cinder-852828-2-iscsi devstack@keystone.service[93170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 11:35:46.023023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:35:46.023023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: from cryptography.utils import int_from_bytes Aug 12 11:35:46.023800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:35:46.023800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: from cryptography.utils import int_from_bytes Aug 12 11:35:46.030215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:35:46.030215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: from cryptography.utils import int_from_bytes Aug 12 11:35:46.030675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:35:46.030675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: from cryptography.utils import int_from_bytes Aug 12 11:35:46.078912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:35:46.079070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:35:46.079165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:35:46.079239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:35:46.079298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] command line args: [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:35:46.079427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] command line args: [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:35:46.079563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:35:46.079677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:35:46.079758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ================================================================================ {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:35:46.079880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ================================================================================ {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:35:46.080001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] admin_token = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] admin_token = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] config_dir = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] config_dir = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] config_source = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] debug = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.080930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] config_source = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] debug = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.081892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_config_append = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.082906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_dir = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_config_append = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_file = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_dir = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_file = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.083987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.084976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.085900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.086985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] publish_errors = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.087953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] standard_threads = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] publish_errors = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.088968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] use_journal = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] use_json = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] use_stderr = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] use_syslog = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.089925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.090034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.090151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.090269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.090387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] standard_threads = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.091024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.091146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.091258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.091367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.091485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.091597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.091719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.091880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] use_journal = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.091994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.092111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] use_json = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.092232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.092344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] use_stderr = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.092466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.092583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] use_syslog = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.092694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.092810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:35:46.092933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093162 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.093896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.094909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.095940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.096963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.097997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.098940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.099984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.100989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.101980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.102929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.103978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.104863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.105926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.106072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.106764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.106884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.106996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.107969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.108997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.109912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.110956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.111973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.112895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.113996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.114975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.external = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.115879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.password = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] auth.token = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.116995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.117893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.external = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.118928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.password = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.119928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] auth.token = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.120957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.121991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.122988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123327 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123674 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.123946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.124992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.125925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.126970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.127896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.128920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129605 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.129955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.130901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.131938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.132975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.133998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.134976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.135959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136772 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.136893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.137939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.138957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.139996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.140913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.141936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.142988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.143898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.144921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145605 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.145952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.146900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.147969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] role.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] role.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.148996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.149983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150307 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.150896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] role.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] role.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.151930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.152743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.153942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154736 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.154837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.155986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.156899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.157966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.158926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.159963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.160984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.connection = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.161799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.162999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.connection = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.163925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.164945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:35:46.165516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.165877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.166111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.166358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.166594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.166860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.167091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.167330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.167564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:35:46.167732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:35:46.194438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.194694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.194924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.195777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.196012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.196238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.204597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.205902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.233450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.233676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.234342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.234571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.285459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.286357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.340836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.341034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.345634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.345869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.405681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.405849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.405935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.406967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.430191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.430423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.430574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.430724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.430844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.430926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.431932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.443180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.443276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.455879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.455981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.456876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.457006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.457085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.457224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.457303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:35:46.474322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.474532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:35:46.474711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.474921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.475003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:35:46.475123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:35:46.475263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.475397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.475476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:35:46.475661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.475738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.475922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.476003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.476193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.476321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.476450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.488885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.489073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.495774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.495962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.499419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.499628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.499712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.499910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.499991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.500195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.500286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.500474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.500564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.500750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.500833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.501886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.502069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.502150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.502331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.524964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.525075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.526462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.526572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.526770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.526884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.531362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.531645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.531727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.531930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.532011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.532208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.538467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.538775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.538900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.539188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.542841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.543128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.543294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.543409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.544985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.545135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.545262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.545408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.545521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.545790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.562019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.562299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.562484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.562787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.566257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.566838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.569417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.569710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.569967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.570266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.574102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.574694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.577293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.577872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.580442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.580751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.581988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.582187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.582478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.597811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.598102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.598369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.598481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.598650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.598795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.599066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.599331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.605569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.606875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.607670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.607947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.608445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.608725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.610744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.611032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.611336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.611569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.611650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.611858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.611946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.612153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.612456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.612737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.623313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.623595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.623872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.624151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.624222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.624432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.624502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.624751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.624840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.624980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.625051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.625283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.625564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.625846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.642786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.643932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.645721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.646929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.648667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.649847 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.650236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.651473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.651763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.652056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.652349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.653018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.653306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.653588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.658871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.660060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.660418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.661679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.663355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.663645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.663928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.664198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.664636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.664929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.665223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.665501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.672809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.673100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.673377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.674068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.674362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.674668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.680546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.680829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.681109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.681379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.681644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.681772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:35:46.681920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.682946 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.683954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.684145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.684268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.684450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.684728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.685005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.685282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.685546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:35:46.717754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d60e7b79c0 pid: 93182 (default app) Aug 12 11:35:46.719334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d60e7b79c0 pid: 93181 (default app) Aug 12 11:35:46.720984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c97c-8066-4b59-bde7-c4f416d245d7 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:46.721269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c97c-8066-4b59-bde7-c4f416d245d7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:46.721540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c97c-8066-4b59-bde7-c4f416d245d7 None None] PATH_INFO: `/v3` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:46.725814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Aug 12 11:35:46 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:35:54.272155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:54.272675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:54.272675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:54.277056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:35:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:35:54.282790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:54.283176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:54.283335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:54.353627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: INFO dbcounter [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] Registered counter for database keystone Aug 12 11:35:54.372774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG oslo_db.sqlalchemy.engines [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:35:54.378891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writer thread running {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:35:54.555032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG passlib.handlers.bcrypt [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93182) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 11:35:54.555456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG passlib.handlers.bcrypt [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93182) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 11:35:54.609613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:35:54.611205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:35:54.738938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:35:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 11:35:55.203893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:35:55.272221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: INFO dbcounter [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] Registered counter for database keystone Aug 12 11:35:55.294991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG oslo_db.sqlalchemy.engines [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:35:55.302059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writer thread running {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:35:55.419556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ea474-61ee-430c-a8c4-97bace8a4f24 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:35:55.423771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:35:55.424395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:55.424677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:55.424951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:55.433182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:35:55.484404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 11:35:55.484691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d00d-bcd2-4391-be80-9150bee1763a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:35:55.493994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Aug 12 11:35:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:35:55.500628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:35:55.515940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37fc5f-03de-420a-a27c-eb053d4b7c5e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:35:55.520279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:35:55.521363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:55.521665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:55.521942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] PATH_INFO: `/v3/projects/eb962a2585ab4e27ac665ceb80fa0708` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:55.523430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] RBAC: Authorizing `identity:get_project(project_id=eb962a2585ab4e27ac665ceb80fa0708)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:35:55.577436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 11:35:55.577779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030ea8-b381-4d59-9dcc-8220c3ef8c3e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:35:55.583038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Aug 12 11:35:55 2022] GET /identity/v3/projects/eb962a2585ab4e27ac665ceb80fa0708 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:35:57.429109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccc9b-bdd5-4530-bb55-4801497e747c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:57.429650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccc9b-bdd5-4530-bb55-4801497e747c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:57.429650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccc9b-bdd5-4530-bb55-4801497e747c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:57.434267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:35:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:35:57.439470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:57.439874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:57.440041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:57.461237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:35:57.462749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:35:57.470422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:35:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 11:35:57.733182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccc9b-bdd5-4530-bb55-4801497e747c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:35:57.745207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccc9b-bdd5-4530-bb55-4801497e747c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:35:57.749975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bfd8-5f31-4e6e-8a2f-93f22b3929c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:35:57.750569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bfd8-5f31-4e6e-8a2f-93f22b3929c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:57.750884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bfd8-5f31-4e6e-8a2f-93f22b3929c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:57.751159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bfd8-5f31-4e6e-8a2f-93f22b3929c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:57.758709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6bfd8-5f31-4e6e-8a2f-93f22b3929c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:35:57.760486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6bfd8-5f31-4e6e-8a2f-93f22b3929c3 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:35:57.769613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Aug 12 11:35:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:35:57.774582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:35:57.784077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fb57-1a5e-4fea-81fa-7c5eb29089d1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:35:57.788300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d3e62-cec2-4c68-95a4-e6a1ebecdf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:35:57.788912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d3e62-cec2-4c68-95a4-e6a1ebecdf3b admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:57.789187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d3e62-cec2-4c68-95a4-e6a1ebecdf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:57.789460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d3e62-cec2-4c68-95a4-e6a1ebecdf3b admin admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:57.790838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d3e62-cec2-4c68-95a4-e6a1ebecdf3b admin admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:35:57.792630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d3e62-cec2-4c68-95a4-e6a1ebecdf3b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:35:57.794143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Aug 12 11:35:57 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:35:59.736384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5cf7-2de0-4437-869a-82977e2ee799 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:59.736929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5cf7-2de0-4437-869a-82977e2ee799 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:59.736929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5cf7-2de0-4437-869a-82977e2ee799 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:59.738225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:35:59.743468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:59.743906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:59.744142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:59.762488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:35:59.763669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:35:59.801091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257705c1-c69f-4117-96c7-da6c25b45fe1 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:59.801372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257705c1-c69f-4117-96c7-da6c25b45fe1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:59.801643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257705c1-c69f-4117-96c7-da6c25b45fe1 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:59.802973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:35:59.808121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:35:59.808409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:35:59.808725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:35:59.843892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:35:59.851474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG passlib.handlers.bcrypt [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 11:35:59.851915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG passlib.handlers.bcrypt [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 11:35:59.897197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:35:59.898833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:00.004487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:00.105235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.129202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.208381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfd937-6bf4-4445-9992-5e8efdfc2ac6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.240664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.241300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.241580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.241855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.253106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:00.261853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:00.262798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:00.263621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:00.268884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.279095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.360668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.369664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dc7e9-9b32-4dce-8bc7-c8a3ea6c8866 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.371981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.379566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efebaa-b598-41ce-a1ce-2d7a2e836241 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.407210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.408283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.408566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.408842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.409678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:00.409985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:00.411455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:00.414617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.415233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.415513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.415786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.423650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:00.429492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.482055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:00.483799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:00.525578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafd19b-c58b-4746-9f60-1c7acacefee8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.561249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.562139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.562426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.562735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.564330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:00.565813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:00.567527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:00.573380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.609400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.670498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.677913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc62e9-b664-4c03-8cb7-924bc7fd029e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.690533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:36:00.696068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.711946 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.712581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.712965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.713470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.715441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:00.718836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:00.718836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:00.724524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.799068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f37e-e0dd-4dc2-ba64-bd2029b8882b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.820779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f5b5-dc43-4270-93af-dccc8d120741 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:00.822261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.832727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.833339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.833646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.833928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.844710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:00.846150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:00.856108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:00.856711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:00.856992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:00.857262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:00.857983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.domain.id=default, user.id=1a0b7676c79e47efbad45a84392bc86a) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:00.858289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:00.859759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6616dc-fe5a-4435-8a58-a783c3d09768 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:36:00.861825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:00.863047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:36:00.864171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:36:00.864171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:36:00.864171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:00.864171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:00.878011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/role_assignments?user.id=1a0b7676c79e47efbad45a84392bc86a&scope.domain.id=default&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:00.878807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:00.907242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:00.977049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256df76-9993-4fae-aff3-95c2ba7bc2e7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:01.011151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:01.012294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:01.012575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:01.012847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:01.013496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:01.013796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:01.015239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53a713-622e-443d-ba5f-e979471abb6e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:01.032898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:02.825078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98620b-3803-418a-b278-bcadfa295526 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:02.825582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98620b-3803-418a-b278-bcadfa295526 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:02.825654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98620b-3803-418a-b278-bcadfa295526 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:02.826969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:02.832364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95850-e7bd-42b8-826b-42ebed295d93 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:02.833127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95850-e7bd-42b8-826b-42ebed295d93 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:02.833546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95850-e7bd-42b8-826b-42ebed295d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:02.856696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cba95850-e7bd-42b8-826b-42ebed295d93 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:02.858107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cba95850-e7bd-42b8-826b-42ebed295d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:02.955117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:03.191432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8957aa-575e-4fde-87b2-686795cc17d2 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:03.191637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8957aa-575e-4fde-87b2-686795cc17d2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:03.192122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8957aa-575e-4fde-87b2-686795cc17d2 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:03.193859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:03.204589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:03.204958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:03.205250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:03.224015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:03.225502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:03.243754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:03.309427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:03.417686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8957aa-575e-4fde-87b2-686795cc17d2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:03.532520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8957aa-575e-4fde-87b2-686795cc17d2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:03.578049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:03.579043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:03.579549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:03.580019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:03.591809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:03.606894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:03.607760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:03.608525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:03.610842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 14/26] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:03.616784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:03.741239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f44e-0c87-4768-a7d0-25593c8aa7a0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:03.787892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:03.788837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:03.789314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:03.789785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:03.790866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:03.791371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:03.793305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b345fd9-dcd5-4480-a131-4ca669ac9c50 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:03.810065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 13/27] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:03.815942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:03.849889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:03.859357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07bdf-d1e4-402b-96b9-62fca7829d8c None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:03.860324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07bdf-d1e4-402b-96b9-62fca7829d8c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:03.860800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d07bdf-d1e4-402b-96b9-62fca7829d8c None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:03.862676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:03.869794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:03.870392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:03.871092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:03.903463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:03.904660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:03.927576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:04.004425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740f04-7931-4e47-872e-ce29b10bcffb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.044714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:04.051191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:04.171870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64514061-4782-4e17-a8f6-0049fb928606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.172518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514061-4782-4e17-a8f6-0049fb928606 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.172795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514061-4782-4e17-a8f6-0049fb928606 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.173121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64514061-4782-4e17-a8f6-0049fb928606 None admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.174948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64514061-4782-4e17-a8f6-0049fb928606 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.177764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64514061-4782-4e17-a8f6-0049fb928606 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:04.189833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:03 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:04.189833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90913b1-f805-47ed-b9b6-7744b42d2453 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.189833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90913b1-f805-47ed-b9b6-7744b42d2453 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.189833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90913b1-f805-47ed-b9b6-7744b42d2453 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.191207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 16/31] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:04.195856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90913b1-f805-47ed-b9b6-7744b42d2453 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:04.266643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5a6b-1a7f-43e5-b09b-b5ab919b01c5 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.311256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.311884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.312162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.312434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.335020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.336484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:04.350956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c6351d31-186b-46ab-aeb2-382d591f3b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:36:04.374441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:04.375399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:36:04.376205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:36:04.376205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:36:04.376205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:04.376205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 16/32] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:04.377181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.377463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.377734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.399367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:04.400563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:04.403629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:04.417532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90913b1-f805-47ed-b9b6-7744b42d2453 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.455416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.456092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.456369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.456641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.457904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.459508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:04.461494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:04.462243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:04.498478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 17/34] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:04.500054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:04.585075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b205-ee37-4fcb-b907-407675a8adf1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.620188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800190d4-f3df-4cfd-8299-72ed1c7d074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.621461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800190d4-f3df-4cfd-8299-72ed1c7d074a None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.621751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800190d4-f3df-4cfd-8299-72ed1c7d074a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.622242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800190d4-f3df-4cfd-8299-72ed1c7d074a None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.622723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800190d4-f3df-4cfd-8299-72ed1c7d074a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.624179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800190d4-f3df-4cfd-8299-72ed1c7d074a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:04.632223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbe1c3-b6e0-484c-954e-54ad961fa12e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.662001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:04.671671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.672421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.672778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.673129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.673894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:04.674277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.676033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:04.688423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:04.693556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:04.762560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 18/36] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 12 11:36:04 2022] POST /identity/v3/roles => generated 219 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:04.764458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3a9f-0f5c-4d7d-a852-15aa838c23e3 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.764961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3a9f-0f5c-4d7d-a852-15aa838c23e3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.765337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3a9f-0f5c-4d7d-a852-15aa838c23e3 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.767071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 19/37] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:04.767868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3a9f-0f5c-4d7d-a852-15aa838c23e3 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:04.796706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:04.807488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228fafb-ad11-447e-bd0c-400f74032276 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.886358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb770ea8-c6d9-4d9f-ac4b-fe4b874d14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.888100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770ea8-c6d9-4d9f-ac4b-fe4b874d14ee None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.888100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770ea8-c6d9-4d9f-ac4b-fe4b874d14ee None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.888100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770ea8-c6d9-4d9f-ac4b-fe4b874d14ee None admin] PATH_INFO: `/v3/domains/default/users/1a0b7676c79e47efbad45a84392bc86a/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.893802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb770ea8-c6d9-4d9f-ac4b-fe4b874d14ee None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1a0b7676c79e47efbad45a84392bc86a, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.895359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb770ea8-c6d9-4d9f-ac4b-fe4b874d14ee None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:04.928472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3a9f-0f5c-4d7d-a852-15aa838c23e3 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:04.977973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:04.978673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:04.978964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:04.979245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:04.979902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:04.982192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:05.026844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 20/38] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:36:04 2022] POST /identity/v3/projects => generated 301 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:05.029197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:05.042382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Aug 12 11:36:04 2022] PUT /identity/v3/domains/default/users/1a0b7676c79e47efbad45a84392bc86a/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:05.044643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85150f-1649-40bd-ae98-9357c8280165 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.045168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85150f-1649-40bd-ae98-9357c8280165 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.045643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85150f-1649-40bd-ae98-9357c8280165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.107929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4e85150f-1649-40bd-ae98-9357c8280165 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:05.109966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4e85150f-1649-40bd-ae98-9357c8280165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:05.153217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:05.191353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338031e-3daf-4905-b367-efeff440d49c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:05.222006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:05.250557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:05.255255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.256189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.256720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.257624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:05.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:05.262299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:05.264452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51677de7-e4d6-4b51-b3a2-386ff5937519 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.264452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51677de7-e4d6-4b51-b3a2-386ff5937519 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.264452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51677de7-e4d6-4b51-b3a2-386ff5937519 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.272187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 21/41] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:05.277690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.277979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.278256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.286651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 12 11:36:05 2022] POST /identity/v3/roles => generated 225 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:05.308305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:05.310154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:05.395306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:05.559326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:05.658944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba29de-ab45-43e8-ba79-2255e873d92e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:05.672505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:05.703183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:05.704203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.704490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.705031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.705706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:05.707373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:05.711748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:05.727130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 12 11:36:05 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:05.781585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6027-72cd-4181-bd4e-d56a4ea172ec None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:05.792683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:05.822507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f89f1e-7316-46f5-8716-d5e43ad4bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:05.823197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89f1e-7316-46f5-8716-d5e43ad4bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.823481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89f1e-7316-46f5-8716-d5e43ad4bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.823756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89f1e-7316-46f5-8716-d5e43ad4bfb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.824980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f89f1e-7316-46f5-8716-d5e43ad4bfb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:05.826599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f89f1e-7316-46f5-8716-d5e43ad4bfb5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:05.828458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 23/45] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:05.834252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:05.944382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a63c7-2766-4469-83f8-d2e892940e4c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:05.977076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0048-0567-4159-9b58-0a8d7501b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:05.977680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0048-0567-4159-9b58-0a8d7501b2a8 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:05.977963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0048-0567-4159-9b58-0a8d7501b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:05.978239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0048-0567-4159-9b58-0a8d7501b2a8 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:05.978902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0048-0567-4159-9b58-0a8d7501b2a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:05.980357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0048-0567-4159-9b58-0a8d7501b2a8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:06.005249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:36:05 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:36:07.098622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ba11-74ee-459e-8887-28da7d42aa47 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.099155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ba11-74ee-459e-8887-28da7d42aa47 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.099238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ba11-74ee-459e-8887-28da7d42aa47 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.100583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:07.105858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.106264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.106422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.124750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:07.126183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:07.166832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:07.191799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:07.457294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994ba11-74ee-459e-8887-28da7d42aa47 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:07.563960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994ba11-74ee-459e-8887-28da7d42aa47 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:07.596247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:07.596874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.597155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.597429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.607701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:07.612405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:07.613227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:07.613986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:07.619484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:07.715764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d8377-6ae2-4f9d-8854-2b6057031a40 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:07.749005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:07.749617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.749906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.750185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.750883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:07.751192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:07.752576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bae16-2b30-424f-bf37-4c79bd0b96be None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:07.760563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:07.766630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:07.802027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:07.865660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bebaa5-d962-4284-a43d-794dc5872455 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:07.869228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c8f3-9d56-48b3-ae10-e39d914ae6e1 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.869524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c8f3-9d56-48b3-ae10-e39d914ae6e1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.869809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c8f3-9d56-48b3-ae10-e39d914ae6e1 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.871895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 26/51] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:07.877063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.877347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.877625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.895950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:07.897135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:07.902360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:07.903021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:07.903304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:07.903583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:07.904708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:07.906151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:07.907768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:07 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:07.913279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:07.927019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:07.965232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:08.010237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8898ee5-56f8-4972-a2fc-8efca8007c2d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:08.012964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:08.043340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:08.043982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:08.044243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:08.044512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:08.045608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:08.047084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:08.048628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:08.054578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:08.148408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28bfc7-fabf-4f8b-8c6e-0ffe14c4de6e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:08.181780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:08.182380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:08.182690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:08.182966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:08.183685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.domain.id=default, user.id=1a0b7676c79e47efbad45a84392bc86a) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:08.184004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:08.185425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:08.191121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Aug 12 11:36:08 2022] GET /identity/v3/role_assignments?user.id=1a0b7676c79e47efbad45a84392bc86a&scope.domain.id=default&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:08.231208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:08.333723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38bf64-80c9-4372-bb75-149624c33ce2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:08.368760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f9f6-84c3-4791-9491-c37037bd56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:08.369389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f9f6-84c3-4791-9491-c37037bd56d1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:08.369669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f9f6-84c3-4791-9491-c37037bd56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:08.369943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f9f6-84c3-4791-9491-c37037bd56d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:08.371063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f9f6-84c3-4791-9491-c37037bd56d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:08.372502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f9f6-84c3-4791-9491-c37037bd56d1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:08.374217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:08.379667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:08.412775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:08.478948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce407-d0a3-4e88-a01a-d6a468350e4a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:08.512654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc3e8f-b68a-40c0-92bf-96a04f9cb509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:08.513259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc3e8f-b68a-40c0-92bf-96a04f9cb509 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:08.513540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc3e8f-b68a-40c0-92bf-96a04f9cb509 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:08.513813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc3e8f-b68a-40c0-92bf-96a04f9cb509 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:08.514449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc3e8f-b68a-40c0-92bf-96a04f9cb509 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:08.515914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc3e8f-b68a-40c0-92bf-96a04f9cb509 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:08.541569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Aug 12 11:36:08 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:10.406164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc245-8825-4e93-b7ab-e5aff055c6fb None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:10.406704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc245-8825-4e93-b7ab-e5aff055c6fb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:10.406787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc245-8825-4e93-b7ab-e5aff055c6fb None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:10.408110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:10.413478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:10.413948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:10.414267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:10.432813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:10.434011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:10.498623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:10.769922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc245-8825-4e93-b7ab-e5aff055c6fb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:10.812072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:10.867721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc245-8825-4e93-b7ab-e5aff055c6fb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:10.903426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9b3c5-11ad-4d4a-8aa5-206b1782501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:10.904064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9b3c5-11ad-4d4a-8aa5-206b1782501c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:10.904340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9b3c5-11ad-4d4a-8aa5-206b1782501c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:10.904611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9b3c5-11ad-4d4a-8aa5-206b1782501c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:10.905719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9b3c5-11ad-4d4a-8aa5-206b1782501c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:10.907220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9b3c5-11ad-4d4a-8aa5-206b1782501c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:10.908783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:10.914997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:10.930913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:11.012052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3172349-034a-4b72-a9fc-79461a2124f8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:11.043213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b3413-3f91-425a-9cd1-2f2c6731838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:11.043749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b3413-3f91-425a-9cd1-2f2c6731838d None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:11.044029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b3413-3f91-425a-9cd1-2f2c6731838d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:11.044302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b3413-3f91-425a-9cd1-2f2c6731838d None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:11.044944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b3413-3f91-425a-9cd1-2f2c6731838d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:11.046377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b3413-3f91-425a-9cd1-2f2c6731838d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:11.071928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:10 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:13.743035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf24b7-dbe0-426e-a2f5-c5bccbae7d03 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:13.744066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf24b7-dbe0-426e-a2f5-c5bccbae7d03 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:13.744555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf24b7-dbe0-426e-a2f5-c5bccbae7d03 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:13.747260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:13.752656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5daa-22b8-42c3-b95a-f3c752c94126 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:13.753605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5daa-22b8-42c3-b95a-f3c752c94126 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:13.754086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5daa-22b8-42c3-b95a-f3c752c94126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:13.783843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-582d5daa-22b8-42c3-b95a-f3c752c94126 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:13.785124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-582d5daa-22b8-42c3-b95a-f3c752c94126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:13.885404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:13.888244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:14.165412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe4f0-382b-44e2-9412-1cfab081b902 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.166095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe4f0-382b-44e2-9412-1cfab081b902 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.166630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe4f0-382b-44e2-9412-1cfab081b902 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.168193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 32/64] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:14.174015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e4675-ad7b-4d7e-8b99-d99a3b13d2e4 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.174303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e4675-ad7b-4d7e-8b99-d99a3b13d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.174581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e4675-ad7b-4d7e-8b99-d99a3b13d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.199929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-de8e4675-ad7b-4d7e-8b99-d99a3b13d2e4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:14.201439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-de8e4675-ad7b-4d7e-8b99-d99a3b13d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:14.266963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbe4f0-382b-44e2-9412-1cfab081b902 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:14.305317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 33/65] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:14.325541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922c00-9387-4784-b5fa-0317a4e80fc5 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.326106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922c00-9387-4784-b5fa-0317a4e80fc5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.326383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922c00-9387-4784-b5fa-0317a4e80fc5 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.327751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 34/66] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:14.340306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.340594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.340874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.366348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:14.367578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:14.459839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbe4f0-382b-44e2-9412-1cfab081b902 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:14.471033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:14.500140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 35/67] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:14.521495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:14.522136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.522413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.522719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.536614 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:14.541269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:14.542285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:14.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 33/68] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:14.550799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:14.624706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:14.634550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:14.677408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63603aa-c966-41eb-961f-0aa39c95edb6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:14.722974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:14.723560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.723843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.724115 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.724783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:14.725086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:14.726461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:14.745097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 36/69] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:14.750669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:14.813807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ff642-c580-436e-bb1d-1089fe822ec9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:14.851084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476399-e2b9-4c1e-9256-281d7bcd00a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:14.852076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476399-e2b9-4c1e-9256-281d7bcd00a0 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.852357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476399-e2b9-4c1e-9256-281d7bcd00a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.852932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476399-e2b9-4c1e-9256-281d7bcd00a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.865571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476399-e2b9-4c1e-9256-281d7bcd00a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b8476399-e2b9-4c1e-9256-281d7bcd00a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:14.870791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:14.872213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 34/70] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:14.877594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf81b7d-7d6f-4007-9533-beab65e8e341 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.878796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf81b7d-7d6f-4007-9533-beab65e8e341 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.878796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf81b7d-7d6f-4007-9533-beab65e8e341 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.878796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 35/71] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:14.880406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf81b7d-7d6f-4007-9533-beab65e8e341 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:14.882168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c371c-b12c-4246-8530-9b3475a45f9f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:14.905566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:14.909042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:14.917197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf8170-8027-47f0-8aa8-a036976a329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:14.917836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf8170-8027-47f0-8aa8-a036976a329f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.918121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf8170-8027-47f0-8aa8-a036976a329f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.918950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf8170-8027-47f0-8aa8-a036976a329f None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.933549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf8170-8027-47f0-8aa8-a036976a329f None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:14.935596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf8170-8027-47f0-8aa8-a036976a329f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:14.937210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:14 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:14.938333 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c676c2-05bc-4240-aa4e-767935b52da3 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:14.938637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c676c2-05bc-4240-aa4e-767935b52da3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:14.938924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c676c2-05bc-4240-aa4e-767935b52da3 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:14.940126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 38/73] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:14.940817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c676c2-05bc-4240-aa4e-767935b52da3 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:14.987201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf81b7d-7d6f-4007-9533-beab65e8e341 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.022679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570c29-f4b2-4f06-8935-37dfb00a66bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.023308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570c29-f4b2-4f06-8935-37dfb00a66bc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.023589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570c29-f4b2-4f06-8935-37dfb00a66bc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.024054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570c29-f4b2-4f06-8935-37dfb00a66bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.033839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570c29-f4b2-4f06-8935-37dfb00a66bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-3f570c29-f4b2-4f06-8935-37dfb00a66bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:15.038537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:15.039532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:15.040457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:15.041212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c676c2-05bc-4240-aa4e-767935b52da3 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.041287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 36/74] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:15.046264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce7a0b-7024-4fcc-8249-587397dde223 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.046563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce7a0b-7024-4fcc-8249-587397dde223 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.046882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce7a0b-7024-4fcc-8249-587397dde223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.064369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3fce7a0b-7024-4fcc-8249-587397dde223 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:15.065558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3fce7a0b-7024-4fcc-8249-587397dde223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:15.073044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.073682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.073967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.074247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.074945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:15.075255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.076603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.084538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 39/75] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.085308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.127706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.131825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 37/76] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:15.132925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.133212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.133490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.150915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:15.152095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:15.165733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.199685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437a2f1-aa7d-4f79-a56a-caaebc844cc1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.227130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:15.227870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.250180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.250180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.250180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.250180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.330159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.332064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.350479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70ab75-65b1-454a-bd47-b763ee8c2b27 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.385583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.388897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.391002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.391295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.391570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.392268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:15.392780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.394535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.406136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 39/78] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.407016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.422647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.453540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 40/79] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:15.454371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.519712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d2caf-2eb1-4c40-ba2a-efa3650230b1 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.551352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82cf2-9681-4ce7-89f4-aaa21c4c9bff None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.552998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.553626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.553907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.554186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.555357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.556796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.558585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 40/80] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.559690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.586174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.586893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.587173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.587453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.597212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:15.602002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:15.602978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:15.603731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 41/81] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:15.604347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.606806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.641694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.663100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e09a9-b0ae-4428-927f-25d85cce0966 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.696502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.697124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.697405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.697679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.698831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.700284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.701834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 41/82] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.702547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f38d9-2485-43ea-a4f2-89df3fbdae6a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.702686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.736266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.736907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.737195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.737472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.738635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.740088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.741712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 42/83] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.742471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.799044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671994-eee9-492f-b1d4-86f2e217b204 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.810290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.832481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.833110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.833388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.833665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.834803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.836264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.837817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 42/84] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.838576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:15.841635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05925500-315c-402d-b1ee-ac6e260072b6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.853912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:15.876989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.877597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.877878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.878149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.938474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7196-aa0f-4110-9a42-623127897093 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:15.944769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.946245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.970685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:15.971288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:15.971573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:15.971849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:15.972506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:15.972808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:15.974166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:15.982809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 43/85] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:15.985102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.013502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.051028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 43/86] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:16.051028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.065549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.088446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906ded-9c95-44da-ae71-de299b70c133 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.122993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.123609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.123896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.124174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.147753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d09a3-9faa-4dbb-9394-fbba7f0615ba None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.191193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.192664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.202392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.203030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.203311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.203582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.204303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=75a946fcd4484fcca6a90b54668cd390) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:16.204614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.206069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.211353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 44/87] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/role_assignments?user.id=75a946fcd4484fcca6a90b54668cd390&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:16.212101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.249982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.295800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.321542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc650-d2ef-4055-a2dd-3b4a95b1b296 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.326658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 44/88] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:16.326658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.364902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48db22-d531-498f-892c-722630b16bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.365519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48db22-d531-498f-892c-722630b16bad None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.365800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48db22-d531-498f-892c-722630b16bad None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.366078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48db22-d531-498f-892c-722630b16bad None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.367769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48db22-d531-498f-892c-722630b16bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.368193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48db22-d531-498f-892c-722630b16bad None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.391984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 45/89] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:16 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:16.393331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48db22-d531-498f-892c-722630b16bad None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.445404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325117ff-2b33-47d6-b716-b2f17043f8ba None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.487619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.488305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.488819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.489106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.491135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.493158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.496030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 45/90] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:16.497192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.534956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.545612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48db22-d531-498f-892c-722630b16bad None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.568576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.587728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.588456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.589079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.589374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.591125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.592570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.594224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 46/91] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:16.595022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.635130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38abba-89cd-4391-8546-7857b2c67c74 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.685469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.686395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.686715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.687000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.688516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.689981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.692033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 46/92] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:16.692754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.714646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457afdc-9d11-4e06-a088-d020e62b99fd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.751788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.752407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.752691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.752976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.781343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.817756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63729-ec3f-4a8f-ab80-48fc2299722d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:16.823759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.825266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.833386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:16.874719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:16.874719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:16.874719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:16.874719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:16.875558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=1a0b7676c79e47efbad45a84392bc86a) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:16.875558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:16.875558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:16.886434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 47/93] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/role_assignments?user.id=1a0b7676c79e47efbad45a84392bc86a&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:16.888894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:16.932513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:16.938787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:17.015944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8c4d-2fbc-4db4-963e-213f8d1d17fb None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:17.041841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:17.088490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:17.089135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:17.089418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:17.089698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:17.090504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] RBAC: Adding query filter params (role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=75a946fcd4484fcca6a90b54668cd390) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:17.090849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:17.092353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:17.099467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 48/95] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/role_assignments?user.id=75a946fcd4484fcca6a90b54668cd390&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=df14a02f49874f9892c73d73eac93c84 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:17.120063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fc0ac-6b61-4f7e-821e-b8105c7ac034 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:17.159758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f66d7-7307-4574-b5ec-8bb4d419a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:17.160324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f66d7-7307-4574-b5ec-8bb4d419a297 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:17.160608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f66d7-7307-4574-b5ec-8bb4d419a297 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:17.160886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f66d7-7307-4574-b5ec-8bb4d419a297 None admin] PATH_INFO: `/v3/projects/161eac5fa0764670ad3fab785d8f8240` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:17.162026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f66d7-7307-4574-b5ec-8bb4d419a297 None admin] RBAC: Authorizing `identity:get_project(project_id=161eac5fa0764670ad3fab785d8f8240)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:17.163549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f66d7-7307-4574-b5ec-8bb4d419a297 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:17.165242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:16 2022] GET /identity/v3/projects/161eac5fa0764670ad3fab785d8f8240 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:17.171863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:17.248714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:17.314482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4028-d6b6-4c93-bf26-33dbcdc99ed6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:17.350993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:17.351629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:17.351914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:17.352190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:17.352938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=161eac5fa0764670ad3fab785d8f8240, user.id=75a946fcd4484fcca6a90b54668cd390) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:17.353249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:17.355019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6c4ac-750d-4460-8296-e3a2dc4a6d5d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:17.365639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 49/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:17 2022] GET /identity/v3/role_assignments?user.id=75a946fcd4484fcca6a90b54668cd390&scope.project.id=161eac5fa0764670ad3fab785d8f8240&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:18.677008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c43634-5a7f-4eb1-ab4b-14f3a6521859 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:18.677514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c43634-5a7f-4eb1-ab4b-14f3a6521859 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:18.677616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c43634-5a7f-4eb1-ab4b-14f3a6521859 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:18.678937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 49/98] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:18.687008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfa59-075f-4809-981d-e7aaa7aec40b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:18.687873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfa59-075f-4809-981d-e7aaa7aec40b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:18.688359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfa59-075f-4809-981d-e7aaa7aec40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:18.712949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ba2bfa59-075f-4809-981d-e7aaa7aec40b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:18.714451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ba2bfa59-075f-4809-981d-e7aaa7aec40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:18.798752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:19.212468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c43634-5a7f-4eb1-ab4b-14f3a6521859 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:19.276732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900b443-9f5f-4ce9-b916-4f2d8b41366f None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.277374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900b443-9f5f-4ce9-b916-4f2d8b41366f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.277889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900b443-9f5f-4ce9-b916-4f2d8b41366f None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.279458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 51/100] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:19.284440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14018157-feeb-4d1f-a962-a19861b722bf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.284964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14018157-feeb-4d1f-a962-a19861b722bf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.285455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14018157-feeb-4d1f-a962-a19861b722bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.315680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-14018157-feeb-4d1f-a962-a19861b722bf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:19.318176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-14018157-feeb-4d1f-a962-a19861b722bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:19.389525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:19.427839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c43634-5a7f-4eb1-ab4b-14f3a6521859 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:19.446083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 52/101] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:19.447247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5bc23-be89-4138-a89e-6bbf7262d77b None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.447539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5bc23-be89-4138-a89e-6bbf7262d77b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.447818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5bc23-be89-4138-a89e-6bbf7262d77b None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.449838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 53/102] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:19.456630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.456914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.457191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.485912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:19.486073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:19.486150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:19.496033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:19.497505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.497987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.498556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.515963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:19.528757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:19.529613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:19.530366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:19.532766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 50/103] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:19.538726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:19.555091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 54/104] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:19.692568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fc510-c016-47f9-b1b7-2560d02b87ae None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:19.738302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:19.738860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.739147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.739426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.740095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:19.740399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:19.741780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbee84e-70b8-42cf-b262-f7a822766ec0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:19.750075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 51/105] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:19.755791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:19.882873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8986-c49d-4687-ac89-aec2068a5e61 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:19.891404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:19.893482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556df0-91a4-489c-a40d-92a8b5de51ce None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.894028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556df0-91a4-489c-a40d-92a8b5de51ce None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.894506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556df0-91a4-489c-a40d-92a8b5de51ce None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.896362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 52/106] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:19.901966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.902562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.903092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.920462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:19.921194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:19.921471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:19.921742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:19.923052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:19.924575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:19.926432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 55/107] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:19 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:19.934749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:19.947769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:19.949203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:20.001670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.026401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 53/108] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:20.027451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.052124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435ce8d-fcff-4bda-a473-61125ff63c0c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.121121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.122298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.122576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.122879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.124012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.125458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.127382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 56/109] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:19 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:20.128052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.165546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf644-cb2a-4258-93ff-aa7ff5c6daee None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.183428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.205277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.205917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.206249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.206529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.216965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:20.221692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:20.223449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 54/110] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:20.225159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.278810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5311fb0-97da-44b5-8030-26dc72ac11ae None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.281277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.330238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a09a9a-f27f-420e-b9ea-f69e02616038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.331191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09a9a-f27f-420e-b9ea-f69e02616038 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.331616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09a9a-f27f-420e-b9ea-f69e02616038 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.332030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09a9a-f27f-420e-b9ea-f69e02616038 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.342943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09a9a-f27f-420e-b9ea-f69e02616038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-57a09a9a-f27f-420e-b9ea-f69e02616038 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:20.347902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:20.348958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:20.349794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:20.350363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aefa2-5e57-4b72-905c-d1b50d58c035 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.351713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 57/111] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:20.353531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12312813-b9e4-4909-90eb-be605ee65439 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.354071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12312813-b9e4-4909-90eb-be605ee65439 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.354561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12312813-b9e4-4909-90eb-be605ee65439 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.356883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 58/112] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:20.358154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12312813-b9e4-4909-90eb-be605ee65439 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.388242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.388907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.389192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.389476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/75a946fcd4484fcca6a90b54668cd390/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b2fab78c442109d26a2199f9d88cc, user_id=75a946fcd4484fcca6a90b54668cd390, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.393415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.409784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 55/113] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:20 2022] PUT /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/75a946fcd4484fcca6a90b54668cd390/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:20.415942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.481986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.494324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12312813-b9e4-4909-90eb-be605ee65439 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.534258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.534438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.535397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.535893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.537267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:20.537850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.539234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a7be-3e06-40d8-9e34-da0ddac3c94d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.541181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.552931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 59/114] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:20.554097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.584774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.585403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.585693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.586208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.587042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:20.588265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.591071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7420e45-5e89-4c51-8269-4fa8759f5136 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.601066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 56/115] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:20.605708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.605708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.605708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.620961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:20.622692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:20.678219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebe98c-eb86-4709-a811-2fc973ad1595 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.698807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 57/116] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:20.698807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.717435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a8d23-76d1-42c3-b294-fcf335fc8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.718096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8d23-76d1-42c3-b294-fcf335fc8140 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.718375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8d23-76d1-42c3-b294-fcf335fc8140 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.718692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8d23-76d1-42c3-b294-fcf335fc8140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.719843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a8d23-76d1-42c3-b294-fcf335fc8140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.721386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a8d23-76d1-42c3-b294-fcf335fc8140 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.723084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 60/117] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:20.727609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54978-b590-4ec4-8de0-9015bcc714fa None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.727609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54978-b590-4ec4-8de0-9015bcc714fa None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.727609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54978-b590-4ec4-8de0-9015bcc714fa None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.727609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 61/118] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:20.731058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54978-b590-4ec4-8de0-9015bcc714fa None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.755094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.807704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:20.819202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc112-28c4-43a7-b7a6-215e8efce1a9 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.842145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54978-b590-4ec4-8de0-9015bcc714fa None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:20.855810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.856458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.859270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.859270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.859270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.859672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.861261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 58/119] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:20.862708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:20.891684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aa55f-421b-4fb0-9bca-9b976c1a5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:20.892320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa55f-421b-4fb0-9bca-9b976c1a5094 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.892602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa55f-421b-4fb0-9bca-9b976c1a5094 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.892880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa55f-421b-4fb0-9bca-9b976c1a5094 None admin] PATH_INFO: `/v3/users/0f6e1360ecd84efbbdbb700031be2168` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.907161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398aa55f-421b-4fb0-9bca-9b976c1a5094 None admin] RBAC: Authorizing `identity:get_user(user_id=0f6e1360ecd84efbbdbb700031be2168)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:20.908611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398aa55f-421b-4fb0-9bca-9b976c1a5094 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:20.910257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 62/120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:20 2022] GET /identity/v3/users/0f6e1360ecd84efbbdbb700031be2168 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:20.911439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:20.911721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:20.911995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:20.930078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:20.931288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:20.992011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79d19-1d33-4869-9ce5-2ab9ec9765ff None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.002866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 63/121] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:21.003755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.019785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.053163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.054322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.054910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.055201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.055918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:21.058756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:21.096005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 59/122] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:36:20 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:21.096847 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.111042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.168584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12f7a-482f-4543-a3e6-22c68c034d2a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.220201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a324-ecc9-41d6-8daa-1a74cbe66900 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.249741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.250401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.250717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.251002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.252237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:21.253717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:21.255613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 64/123] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:21.256406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.270911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.271637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.271938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.272708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.361942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.381780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:21.383313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:21.395427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5d4cc-8459-4bb9-a4cf-32123f1ca0ac None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.400515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.443479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.444128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.444572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.444854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.459066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:21.465029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:21.465912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:21.466814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 65/124] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:21.467449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.523237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 60/125] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:21.524119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.588415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea665c-3733-4993-a87e-0cc55865da8a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.624374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.625433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.625934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.626410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/1a0b7676c79e47efbad45a84392bc86a/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.628923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b2fab78c442109d26a2199f9d88cc, user_id=1a0b7676c79e47efbad45a84392bc86a, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:21.630576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:21.634397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.648385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 66/126] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:21 2022] PUT /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/1a0b7676c79e47efbad45a84392bc86a/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:21.649658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.664723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d659e-fe93-41f6-9d06-d61fd57d7fa1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.685976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.735379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.737963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.739311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.739820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.763313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:21.771409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:21.772390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:21.773167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:21.777037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 61/127] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:21.779649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.819485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e389-7201-478c-9ef2-759ab9e2308b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.865763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.867217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.867699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.868191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.874221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:21.874994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:21.876841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:21.886428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 67/128] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:21.888182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:21.923533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394fc54-0d7d-4fb6-a9be-d4c729f8fe1e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:21.966965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:21.986663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:21.986663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:21.986663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:21.986663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:21.988052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:21.989506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:21.991233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 62/129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:21.992977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:22.044923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:22.104579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383dcf4-745c-450f-bc37-c44d2f886728 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:22.109440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27994-5470-42a9-ab35-e072335759cb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:22.145580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:22.146142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.146429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.146734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.147875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:22.149407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:22.151360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 63/130] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:22.152624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:22.242682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:22.243312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.243601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.243887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.244566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:22.244879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:22.246324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:22.268499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 68/131] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:22.269440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:22.285290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df0c17-2930-479d-aa24-37aa28e81ad0 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:22.301677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:22.349902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:22.350525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.350840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.351119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.351858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] RBAC: Adding query filter params (role.id=b418af06458b470faa241952daffaf0a, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=0f6e1360ecd84efbbdbb700031be2168) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:22.352173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:22.353626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:22.365038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 64/132] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:22 2022] GET /identity/v3/role_assignments?user.id=0f6e1360ecd84efbbdbb700031be2168&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=b418af06458b470faa241952daffaf0a => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:22.365867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:22.492512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca9905-0303-4e4a-9063-997a997c56ce None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:22.534940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:22.565144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e68ea-37f1-4bce-b8fe-2bd68bd288a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:22.566834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e68ea-37f1-4bce-b8fe-2bd68bd288a1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.567970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e68ea-37f1-4bce-b8fe-2bd68bd288a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.568611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e68ea-37f1-4bce-b8fe-2bd68bd288a1 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.571007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e68ea-37f1-4bce-b8fe-2bd68bd288a1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:22.573347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e68ea-37f1-4bce-b8fe-2bd68bd288a1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:22.575889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 69/133] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:22 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:22.577402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898133-c568-4570-8c5f-6a1e925da6fb None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.579001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898133-c568-4570-8c5f-6a1e925da6fb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.580161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898133-c568-4570-8c5f-6a1e925da6fb None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.582126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 70/134] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:22.583056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898133-c568-4570-8c5f-6a1e925da6fb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:22.585303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d1eb3-396a-49de-a166-8d0e19d82a9d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:22.655384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5f7ee-5e2e-4e74-b188-8a1d03553669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:22.656038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f7ee-5e2e-4e74-b188-8a1d03553669 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.656327 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f7ee-5e2e-4e74-b188-8a1d03553669 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.656608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f7ee-5e2e-4e74-b188-8a1d03553669 None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.659296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5f7ee-5e2e-4e74-b188-8a1d03553669 None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:22.660737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5f7ee-5e2e-4e74-b188-8a1d03553669 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:22.662651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 65/135] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:22 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:22.663831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.664123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.664402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.697971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:22.700076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:22.757058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:22.765929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898133-c568-4570-8c5f-6a1e925da6fb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:22.808685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:22.809691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:22.810172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:22.810665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/75a946fcd4484fcca6a90b54668cd390/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:22.813394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b2fab78c442109d26a2199f9d88cc, user_id=75a946fcd4484fcca6a90b54668cd390, role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:22.815109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:22.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 71/136] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:22 2022] PUT /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/75a946fcd4484fcca6a90b54668cd390/roles/df14a02f49874f9892c73d73eac93c84 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:22.838342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:22.847445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 66/137] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:22.937535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:23.010906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a86536-1963-48b8-87f9-b4941e57df13 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:23.055517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:23.056162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.056446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.056713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] PATH_INFO: `/v3/projects/161eac5fa0764670ad3fab785d8f8240` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.063485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] RBAC: Authorizing `identity:get_project(project_id=161eac5fa0764670ad3fab785d8f8240)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:23.064991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:23.067101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 72/138] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:22 2022] GET /identity/v3/projects/161eac5fa0764670ad3fab785d8f8240 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:23.072756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:23.148914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:23.230082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ea13-a588-4a8e-90d2-916578257f29 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:23.279214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:23.279812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.280088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.280363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] PATH_INFO: `/v3/projects/161eac5fa0764670ad3fab785d8f8240/users/75a946fcd4484fcca6a90b54668cd390/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.284728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] RBAC: Authorizing `identity:create_grant(project_id=161eac5fa0764670ad3fab785d8f8240, user_id=75a946fcd4484fcca6a90b54668cd390, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:23.286164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:23.322857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 67/139] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:23 2022] PUT /identity/v3/projects/161eac5fa0764670ad3fab785d8f8240/users/75a946fcd4484fcca6a90b54668cd390/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:23.348693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb77e5-c6b1-4301-a49b-c1b78a9f62c2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:23.367045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:23.388506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:23.389159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.389436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.389704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.400835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:23.406421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:23.407357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:23.408160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 73/140] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:23.413711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:23.451586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:23.557098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a7861-6f13-42ec-95dd-ad8f9df5fa2e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:23.597133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:23.597765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.598045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.598325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.599028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:23.599332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:23.600818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f092b0-01fd-4245-a715-c5435ad9bde1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:23.614401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 68/141] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:23.620081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:23.657130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184007-1ea0-4698-bd8f-178eb9f687f1 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.657449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184007-1ea0-4698-bd8f-178eb9f687f1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.657693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184007-1ea0-4698-bd8f-178eb9f687f1 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.659069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 69/142] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:23.665938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.666228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.666501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.700973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:23.702217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:23.773253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f528f-d152-4fc6-8e60-c024acf43cab None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:23.880855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:23.882891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:23.886636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:23.887342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:23.887841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:23.889230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:23.890936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:23.892756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 74/144] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:23 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:23.898922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:23.930646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:24.031393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df9b13-1046-47bf-aa82-df99f441f33d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:24.068110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:24.068722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.069003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.069273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.140214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:24.141597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:24.162774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:24.244984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:24.251752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:24.336727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:24.404980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397679-7ad5-44d9-babd-88cc160b0194 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:24.419430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:24.457546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:24.458182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.458461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.458764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.459996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:24.461459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:24.464429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 75/146] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:24 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:24.472823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:24.565639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c92c5-d6c9-4906-82a9-4657e152727f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:24.600450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:24.627331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:24.627991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.628273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.628548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.629952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:24.631428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:24.633577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 72/147] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:24.639276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:24.671107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0d01d-08d2-4c7d-af05-caacf6356c61 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:24.697709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:24.737803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:24.738420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.738729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.739003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.739735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=75a946fcd4484fcca6a90b54668cd390) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:24.740040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:24.741493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbefb-eb63-4642-ab70-6a399407b4ab None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:24.750749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 76/148] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:24 2022] GET /identity/v3/role_assignments?user.id=75a946fcd4484fcca6a90b54668cd390&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:24.752100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98699d-f9fa-4504-a596-9e56db970140 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.752390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98699d-f9fa-4504-a596-9e56db970140 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.752716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98699d-f9fa-4504-a596-9e56db970140 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.754309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 77/149] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:24.772495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177381d-bffa-491a-ac2f-95814e0b3c53 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.772823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177381d-bffa-491a-ac2f-95814e0b3c53 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.773048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177381d-bffa-491a-ac2f-95814e0b3c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.793027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d177381d-bffa-491a-ac2f-95814e0b3c53 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:24.794264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d177381d-bffa-491a-ac2f-95814e0b3c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:24.836887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f38d-a61a-4c0a-8845-3a42f5ad0682 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:24.875691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 78/150] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:24.940848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fa57a-a3c0-48fc-b3bb-d5ae74de9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:24.941430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fa57a-a3c0-48fc-b3bb-d5ae74de9669 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:24.941679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fa57a-a3c0-48fc-b3bb-d5ae74de9669 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:24.941952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fa57a-a3c0-48fc-b3bb-d5ae74de9669 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:24.942617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fa57a-a3c0-48fc-b3bb-d5ae74de9669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:24.944078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fa57a-a3c0-48fc-b3bb-d5ae74de9669 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:24.979777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 73/151] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:24 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:25.149863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3df3b9-9891-4bfb-8d20-d5c5be8d22ef None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.150559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3df3b9-9891-4bfb-8d20-d5c5be8d22ef None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.151093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3df3b9-9891-4bfb-8d20-d5c5be8d22ef None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.153306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 79/152] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:25.158843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.159135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.159410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.187830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:25.189045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:25.236343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:25.268842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 74/153] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:25.312080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3df3b9-9891-4bfb-8d20-d5c5be8d22ef None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:25.432350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3df3b9-9891-4bfb-8d20-d5c5be8d22ef None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:25.452521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:25.472005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:25.472999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.473482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.473955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.485313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:25.490473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:25.491435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:25.492217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:25.494435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 80/154] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:25.503466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:25.578158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:25.638106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da0260-a817-4242-817d-7febf9cc0d24 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:25.682239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:25.682881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.683268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.683573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.684361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:25.684661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:25.686034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000894ba-bc33-425f-8bfd-0b3e0db0178e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:25.696169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 75/155] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:25.697498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bf030-b607-4130-951e-2d7727775a03 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.697785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bf030-b607-4130-951e-2d7727775a03 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.698053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bf030-b607-4130-951e-2d7727775a03 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.700704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 76/156] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:25.701594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e106-9177-4e6b-b0e2-82590f227f15 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:25.705739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bf030-b607-4130-951e-2d7727775a03 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:25.744901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b9f43-7d94-459f-a7d8-45aecc469466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:25.745590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9f43-7d94-459f-a7d8-45aecc469466 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.745942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9f43-7d94-459f-a7d8-45aecc469466 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.746371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9f43-7d94-459f-a7d8-45aecc469466 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.753986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:25.762408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b9f43-7d94-459f-a7d8-45aecc469466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c62b9f43-7d94-459f-a7d8-45aecc469466 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:25.769343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:25.770343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 81/157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:25.772523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.773279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.773279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.794077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:25.795152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:25.821042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:25.851564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bf030-b607-4130-951e-2d7727775a03 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:25.889891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 82/158] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:25.891200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:25.905551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60e692-4de8-4abf-b1d8-fd84320ee762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:25.906207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e692-4de8-4abf-b1d8-fd84320ee762 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.906490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e692-4de8-4abf-b1d8-fd84320ee762 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.906796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e692-4de8-4abf-b1d8-fd84320ee762 None admin] PATH_INFO: `/v3/users/1a0b7676c79e47efbad45a84392bc86a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.908064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60e692-4de8-4abf-b1d8-fd84320ee762 None admin] RBAC: Authorizing `identity:get_user(user_id=1a0b7676c79e47efbad45a84392bc86a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:25.909549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60e692-4de8-4abf-b1d8-fd84320ee762 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:25.911241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 77/159] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:25 2022] GET /identity/v3/users/1a0b7676c79e47efbad45a84392bc86a => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:25.915812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fde04-9e42-413a-9ddb-e1a977fa0ee8 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:25.915812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fde04-9e42-413a-9ddb-e1a977fa0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:25.915812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fde04-9e42-413a-9ddb-e1a977fa0ee8 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:25.915812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 78/160] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:25.919479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fde04-9e42-413a-9ddb-e1a977fa0ee8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.040489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e49eaa-b93a-4dd6-9346-2b247a7a93fd None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.053517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fde04-9e42-413a-9ddb-e1a977fa0ee8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.057730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.085632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.086351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.086748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.087157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.087895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:26.088311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.090145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5020ee-1833-4018-801c-0e593e414b1e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.100780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 83/161] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:26.105500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.105500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.105500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.107521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.108332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.108741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.109137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.125477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:26.126541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:26.144699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.198431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.200999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.216010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 84/162] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:26.217092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.326998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 79/163] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:26.328419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.334633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.336072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9bdf-de8f-45d8-bba2-49d187c599fd None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.373845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.374821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.375309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.375755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] PATH_INFO: `/v3/users/0f6e1360ecd84efbbdbb700031be2168` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.377258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] RBAC: Authorizing `identity:get_user(user_id=0f6e1360ecd84efbbdbb700031be2168)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.378930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.380732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/users/0f6e1360ecd84efbbdbb700031be2168 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:26.381841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.406966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.438988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb714b4-83d0-471d-a3eb-c20baf5cff8d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.474588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.474588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.475600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.475766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.488143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:26.493996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:26.494953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:26.495725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:26.497135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.504029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b000d5-1f57-497a-81a6-42597b0dc78b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.542313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.543809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.544301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.544730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.546110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.547921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.550419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:26.551499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.561154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.623622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853300-2d21-47f2-a891-0e022778e5cd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.659012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.662590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.663221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.663566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.663850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.665004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.666459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.668731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 81/167] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:26.669749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.678297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a425c4-68a1-46de-b197-c4f6d9c16cc6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.721297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.721918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.722195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.722466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.723157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:26.723456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.725059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.741983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 87/168] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:26.742814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.772459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3233-a702-4c41-a746-c94213c12611 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.802078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:26.807346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.808365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.809492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.810086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.810970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=1a0b7676c79e47efbad45a84392bc86a) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:26.811383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:26.812976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:26.819594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 82/169] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/role_assignments?user.id=1a0b7676c79e47efbad45a84392bc86a&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:26.820499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:26.929387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856b666-c282-46fc-89c6-46caaccc109b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.966853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:26.967505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:26.967788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:26.968061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:26.972220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84d3e-38fe-47b2-8bf0-d640702b40fa None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:26.988355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:26.993917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:26.995171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:26.995969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:27.003676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 83/170] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:27.004575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.023030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:27.024072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:27.024544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:27.025105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/0f6e1360ecd84efbbdbb700031be2168/roles/b418af06458b470faa241952daffaf0a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:27.027493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b2fab78c442109d26a2199f9d88cc, user_id=0f6e1360ecd84efbbdbb700031be2168, role_id=b418af06458b470faa241952daffaf0a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:27.029269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:27.046390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 88/171] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:26 2022] PUT /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/users/0f6e1360ecd84efbbdbb700031be2168/roles/b418af06458b470faa241952daffaf0a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:27.047599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.069355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:27.109577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:27.182206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bc646-8fb6-4062-a755-cb7bde3d8c6c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:27.234861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:27.235516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:27.235830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:27.238628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:27.243565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:27.245177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:27.247046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 84/172] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:27.253674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.300772 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15268d85-4e19-4c04-96a5-f609bc127662 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:27.366763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:27.368184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:27.368593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d98aa-9a1d-4328-ba02-72ebcdbc119b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:27.368951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:27.369421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:27.370317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:27.370845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:27.372538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:27.390735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 89/173] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:27.395621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:27.396489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.415922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:27.416540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:27.416823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:27.417102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:27.530388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:27.553305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:27.556011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:27.601510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a37f7-1a6c-4671-a279-e04487a66273 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:27.670262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:27.670927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:27.671205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:27.671478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] PATH_INFO: `/v3/users/75a946fcd4484fcca6a90b54668cd390` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:27.675423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] RBAC: Authorizing `identity:get_user(user_id=75a946fcd4484fcca6a90b54668cd390)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:27.676888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:27.681253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 90/174] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/users/75a946fcd4484fcca6a90b54668cd390 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:27.687753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.719648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 85/175] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:27.725654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.752615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:27.832816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c66c0-3306-49f4-99e4-04005f25fb50 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:27.882234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:27.883084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:27.883526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:27.883962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:27.889583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:27.891271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:27.893111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 86/176] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:27.899818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:27.960794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd781c1-524a-441f-866a-4d58e416bc6d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:28.034289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb82f-8275-4ffe-980f-00968f52f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:28.035162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb82f-8275-4ffe-980f-00968f52f0af None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:28.035631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb82f-8275-4ffe-980f-00968f52f0af None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:28.036662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb82f-8275-4ffe-980f-00968f52f0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:28.048494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:28.113306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:28.135237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282781-fdd7-4017-93fd-0841f0f66983 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:28.178977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fb82f-8275-4ffe-980f-00968f52f0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:28.180434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fb82f-8275-4ffe-980f-00968f52f0af None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:28.197919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:28.198534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:28.198836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:28.199140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:28.200462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] RBAC: Adding query filter params (role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=75a946fcd4484fcca6a90b54668cd390) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:28.200769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:28.202193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:28.214226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 87/177] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/role_assignments?user.id=75a946fcd4484fcca6a90b54668cd390&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=df14a02f49874f9892c73d73eac93c84 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:28.340588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 91/178] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:36:28.346239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:28.378168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e8a6-14b6-4aad-8757-813fdee43b30 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:28.378723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e8a6-14b6-4aad-8757-813fdee43b30 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:28.378723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e8a6-14b6-4aad-8757-813fdee43b30 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:28.380230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 92/179] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:28.385244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:28.385523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:28.385784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:28.427229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:28.428563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:28.498979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:28.561843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 93/180] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:28.568914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df2fc-4433-480b-bc1e-b622d9c01920 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:28.603160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:28.604132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:28.604647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:28.605125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] PATH_INFO: `/v3/projects/161eac5fa0764670ad3fab785d8f8240` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:28.608087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] RBAC: Authorizing `identity:get_project(project_id=161eac5fa0764670ad3fab785d8f8240)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:28.609823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:28.611691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 88/181] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:28 2022] GET /identity/v3/projects/161eac5fa0764670ad3fab785d8f8240 => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:28.617762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:28.741242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c30e2-ecf0-45a8-a417-da051602aa38 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:28.787990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:28.788610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:28.788890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:28.789165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:28.789896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=161eac5fa0764670ad3fab785d8f8240, user.id=75a946fcd4484fcca6a90b54668cd390) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:28.790206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:28.791681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b7f55-93bc-4f53-b3b1-340f8cbe40be None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:28.803467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 94/182] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:28 2022] GET /identity/v3/role_assignments?user.id=75a946fcd4484fcca6a90b54668cd390&scope.project.id=161eac5fa0764670ad3fab785d8f8240&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:28.941182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:28.972156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.021080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf39d-70d6-4cd8-9c0f-5363bec1b737 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.021354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf39d-70d6-4cd8-9c0f-5363bec1b737 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.021564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf39d-70d6-4cd8-9c0f-5363bec1b737 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.023107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 95/183] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:29.028147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9042b-ecf0-42e2-84ca-7cea564d4760 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.028429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9042b-ecf0-42e2-84ca-7cea564d4760 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.028717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9042b-ecf0-42e2-84ca-7cea564d4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.052535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e2d9042b-ecf0-42e2-84ca-7cea564d4760 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:29.053721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e2d9042b-ecf0-42e2-84ca-7cea564d4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:29.053858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fd91-dafa-45a8-a608-2f6593666310 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.083174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.097621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b23a42-e3e5-490f-a184-13c6f44ca7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.099089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b23a42-e3e5-490f-a184-13c6f44ca7fe None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.099371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b23a42-e3e5-490f-a184-13c6f44ca7fe None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.099644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b23a42-e3e5-490f-a184-13c6f44ca7fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.112284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b23a42-e3e5-490f-a184-13c6f44ca7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-81b23a42-e3e5-490f-a184-13c6f44ca7fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:29.118133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:29.119449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:29.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 89/184] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:29.120867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a993b-c21c-4379-8353-0450a54b5b89 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.120867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a993b-c21c-4379-8353-0450a54b5b89 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.121639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a993b-c21c-4379-8353-0450a54b5b89 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.126878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 90/185] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:29.126878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a993b-c21c-4379-8353-0450a54b5b89 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.148634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 96/186] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:29.150102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.150384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.150740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.169347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:29.170539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:29.238991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.241579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:29.252806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a993b-c21c-4379-8353-0450a54b5b89 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.288550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.289087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.289369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.289642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.290379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:29.290719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:29.292097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:29.300661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 91/188] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:29.306186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.399769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.409428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3593c0-788b-4e89-80aa-b7ce0d7ffe0d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.421894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.455730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.456379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.456812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.457096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] PATH_INFO: `/v3/users/e491d60c26ae402a9133f33871fa29f6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.474458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] RBAC: Authorizing `identity:get_user(user_id=e491d60c26ae402a9133f33871fa29f6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:29.475957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:29.478435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 98/189] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/users/e491d60c26ae402a9133f33871fa29f6 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:29.484464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.539176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96696200-2163-4410-8795-ba3d021a9c32 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.574198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.574862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.575144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.575416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.576528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:29.577955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:29.579735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 92/190] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:29.580304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.592451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7f1e-20dd-4957-bc25-319458ce8b72 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.598719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.629716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.630324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.630632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.630903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.648902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.687039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430fa47-d5f1-4855-bac3-fc4c87f1f32e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.707639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:29.709544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:29.720393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.721023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.721303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.721576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.732047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:29.737157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:29.738010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:29.738827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 93/191] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:29.739483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.818764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.832735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 99/192] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:36:29.838437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.846026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fece-b5da-42e4-b85b-e362dbb71b7d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.882625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.883246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.883526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.883798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.884437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:29.885874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:29.888022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:29.907793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 94/193] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:29 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:29.908676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:29.954893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da521fa-d96a-450a-a288-4f8d081e62ea None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:29.993885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:29.994506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:29.994811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:29.995084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:29.995761 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:29.996640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:29.998048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b30ae-aad8-4c68-bfd8-74cd9268e7ff None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:30.006791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 100/194] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:30.008129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4a39-b80c-425e-8d59-6b65185b1efc None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.008415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4a39-b80c-425e-8d59-6b65185b1efc None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.008692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4a39-b80c-425e-8d59-6b65185b1efc None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.010135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 101/195] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:30.015291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4a39-b80c-425e-8d59-6b65185b1efc None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.032052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea870e-2cce-42c3-a2c8-b337135c4db1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.071254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:30.081669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a495bc8-18b0-4571-acf7-ad490f7cce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:30.082311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a495bc8-18b0-4571-acf7-ad490f7cce24 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.082695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a495bc8-18b0-4571-acf7-ad490f7cce24 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.085627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a495bc8-18b0-4571-acf7-ad490f7cce24 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.085627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a495bc8-18b0-4571-acf7-ad490f7cce24 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:30.086179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a495bc8-18b0-4571-acf7-ad490f7cce24 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:30.088065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 95/196] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:29 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:30.088993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.089273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.089543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.108455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:30.110273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:30.133654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4a39-b80c-425e-8d59-6b65185b1efc None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.146342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:30.180407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:30.181090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.181379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.181787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] PATH_INFO: `/v3/users/e491d60c26ae402a9133f33871fa29f6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.182996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] RBAC: Authorizing `identity:get_user(user_id=e491d60c26ae402a9133f33871fa29f6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:30.184876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:30.187004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 102/197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/users/e491d60c26ae402a9133f33871fa29f6 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:30.187790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.198686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 96/198] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:30.200146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.317212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210afc88-554c-4c5c-a749-650527692d33 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.318588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f39ca-fe36-4b88-a172-22e4253dbe11 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.346841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:30.356701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:30.357338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.357613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.357888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.362011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:30.362229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.362494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.362668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.363405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=e491d60c26ae402a9133f33871fa29f6) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:30.363711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:30.365151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:30.373444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 103/199] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/role_assignments?user.id=e491d60c26ae402a9133f33871fa29f6&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:30.461113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:30.462633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:30.526378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.622460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:30.637314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 97/200] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:30.645730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.681641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:30.699639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3d592-d8cf-4801-926f-f2ef51e14d1f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.736467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:30.737492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.737969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.738435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.750025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:30.756025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:30.756894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:30.757753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:30.760014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 104/201] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:30.768655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.826090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efedfce-7b3e-4b0d-8866-ddefaad5d5c5 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.899373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:30.900020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:30.900303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:30.901971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:30.907514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:30.909079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:30.910817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 98/202] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:30.916832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:30.963439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203eba-37da-4152-a7ec-cad2b812ef53 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:30.965803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:31.014036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:31.014740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:31.015117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:31.015400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:31.016184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:31.016544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:31.018033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:31.028224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 105/203] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:31.035979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:31.055400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:31.066654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463fb2e-19af-4b81-ab7b-3fc19508d3ce None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:31.103627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:31.103627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:31.103627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:31.103627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:31.103990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] RBAC: Adding query filter params (role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=e491d60c26ae402a9133f33871fa29f6) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:31.103990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:31.103990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:31.112477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 99/204] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:30 2022] GET /identity/v3/role_assignments?user.id=e491d60c26ae402a9133f33871fa29f6&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=df14a02f49874f9892c73d73eac93c84 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:31.209739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e2fd-041c-4b1b-91f4-a860a40ba98d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:31.259463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:31.260109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:31.260386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:31.260659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] PATH_INFO: `/v3/users/0f6e1360ecd84efbbdbb700031be2168` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:31.262353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] RBAC: Authorizing `identity:get_user(user_id=0f6e1360ecd84efbbdbb700031be2168)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:31.263822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:31.265701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 106/205] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:31 2022] GET /identity/v3/users/0f6e1360ecd84efbbdbb700031be2168 => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:31.271610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:31.426337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e339f-f80f-4738-97f1-3e7d99bc6a60 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:31.470527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:31.471068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:31.471347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:31.471631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:31.512548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:31.563619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:31.565071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:31.700755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 100/206] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:31.706777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:31.748276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:31.825881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc284e-c02c-41e1-95e0-1ddf6b98cd7f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:31.870095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347edf1-9f53-4b78-befb-a520fe59590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:31.871345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347edf1-9f53-4b78-befb-a520fe59590e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:31.871697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347edf1-9f53-4b78-befb-a520fe59590e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:31.871973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347edf1-9f53-4b78-befb-a520fe59590e None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:31.873120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347edf1-9f53-4b78-befb-a520fe59590e None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:31.874564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347edf1-9f53-4b78-befb-a520fe59590e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:31.876521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 107/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:31 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:31.882302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:31.945583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:31.996757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba81768-2478-452f-8fc7-e275be3044c6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:32.032178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:32.032710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.032985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.033255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.033977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] RBAC: Adding query filter params (role.id=b418af06458b470faa241952daffaf0a, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc, user.id=0f6e1360ecd84efbbdbb700031be2168) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:32.034284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:32.035756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ab32-21d6-402e-be2a-8127c19299a9 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:32.041651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 101/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:31 2022] GET /identity/v3/role_assignments?user.id=0f6e1360ecd84efbbdbb700031be2168&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=b418af06458b470faa241952daffaf0a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:32.400249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336a617-1f94-4d61-983e-8c32966a2fc9 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.400919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336a617-1f94-4d61-983e-8c32966a2fc9 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.401395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336a617-1f94-4d61-983e-8c32966a2fc9 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.403814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 108/209] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:32.409522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35d7aa-f73a-419c-a45d-583ab55a695f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.409969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35d7aa-f73a-419c-a45d-583ab55a695f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.410040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35d7aa-f73a-419c-a45d-583ab55a695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.428740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ea35d7aa-f73a-419c-a45d-583ab55a695f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:32.429916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ea35d7aa-f73a-419c-a45d-583ab55a695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:32.513753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 102/210] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:32.606961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc877ae-43e3-4277-b8b2-8490d8849cf0 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.607570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc877ae-43e3-4277-b8b2-8490d8849cf0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.608034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc877ae-43e3-4277-b8b2-8490d8849cf0 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.609598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 109/211] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:32.615135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736edc0b-d988-4cba-be2a-af6d5486371b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.615484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736edc0b-d988-4cba-be2a-af6d5486371b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.615773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736edc0b-d988-4cba-be2a-af6d5486371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.634200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-736edc0b-d988-4cba-be2a-af6d5486371b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:32.635421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-736edc0b-d988-4cba-be2a-af6d5486371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:32.690126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:32.708300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 103/212] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:32.810720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc877ae-43e3-4277-b8b2-8490d8849cf0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:32.865517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313105-8ac8-465d-ba23-601b026f2400 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.865810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313105-8ac8-465d-ba23-601b026f2400 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.866081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313105-8ac8-465d-ba23-601b026f2400 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.867576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 104/213] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:32.873968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.874427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.874760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.898848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:32.900039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:32.925928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:32.930709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc877ae-43e3-4277-b8b2-8490d8849cf0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:32.966965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:32.967954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:32.968381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:32.968798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:32.979843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 105/214] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:32.980921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:32.986374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:32.987307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:32.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:32.988688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:32.988757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 110/215] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:32.994793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.091559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e7b16-d09f-4f04-9783-aeabca8713c7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.105751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21ada7-d92b-4058-bedc-a433f427ac10 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.107790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.129536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.130596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.131233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.131711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.133018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.134865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.137294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 106/216] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:33.143053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.144759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.145368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.145648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.145924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.146645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:33.146931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.148619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6de363-08fe-43ac-b1d1-7555d75086d5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.157091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 111/217] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:33.158241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69a08-0ca2-4463-93f3-d9d334e52832 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.158517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69a08-0ca2-4463-93f3-d9d334e52832 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.158819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69a08-0ca2-4463-93f3-d9d334e52832 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.160144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 112/218] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:33.163721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69a08-0ca2-4463-93f3-d9d334e52832 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.190632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.255100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9719-a587-4a1c-870d-26e9ecfd9839 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.268749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69a08-0ca2-4463-93f3-d9d334e52832 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.288830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1255b9-5e47-4307-9a65-9eb47f6d8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.289430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1255b9-5e47-4307-9a65-9eb47f6d8235 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.289710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1255b9-5e47-4307-9a65-9eb47f6d8235 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.289977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1255b9-5e47-4307-9a65-9eb47f6d8235 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.290602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1255b9-5e47-4307-9a65-9eb47f6d8235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.292077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1255b9-5e47-4307-9a65-9eb47f6d8235 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.301965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.302587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.302910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.303181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] PATH_INFO: `/v3/users/03241180d254413d9a4ba773b9dbfa9a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.313605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 107/219] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:33 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:33.315065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.315354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.315633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.317217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] RBAC: Authorizing `identity:get_user(user_id=03241180d254413d9a4ba773b9dbfa9a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.318737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.320618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 113/220] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/users/03241180d254413d9a4ba773b9dbfa9a => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:33.321237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.335862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:33.337248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:33.372463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.412684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.418387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:33.419197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.447015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00af41-12dd-4af7-a219-912dd82be764 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.500388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.501035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.501316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.501589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.516340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:33.521068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:33.521955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:33.522789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 114/222] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:33.531991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.546909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973edf6-2167-4161-b171-521ad2df5cf2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.587620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.588241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.588533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.588890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.625492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.649657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915728-3b16-49a4-837d-a1dee8d714fa None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.664953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.666638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.690904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.690904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.690904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.690904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.691342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:33.691485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.692831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.702688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 115/223] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:33.707081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.711353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.800953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 109/224] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:33.801826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.837393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9330a-d2e4-4ec7-8d39-bc71aa5f24fe None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.886423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.887377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.887655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.888532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:33.889551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.905580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:33.912805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:33.913865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:33.914831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:33.916115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 116/225] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:33.916638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:33.932769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c5381-bccf-4e50-8026-b1038e36402c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:33.978285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:33.979244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:33.979553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:33.979829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] PATH_INFO: `/v3/users/e491d60c26ae402a9133f33871fa29f6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:33.981825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] RBAC: Authorizing `identity:get_user(user_id=e491d60c26ae402a9133f33871fa29f6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:33.983771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:33.989675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 110/226] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/users/e491d60c26ae402a9133f33871fa29f6 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:33.989675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.001351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:34.054645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37462-96ae-42de-bf4b-dd2fdc9a22f0 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.103654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea252756-21c7-454c-be28-fdb1869e9d5c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.103852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.104597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.104976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.105374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.107782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.109339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.111138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 117/227] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:34.112026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.151452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.152483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.152867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.153690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.154907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:34.155373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.157405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.160018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:34.170512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:34.171387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.234673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c09a-b065-4fac-9942-9f5221ead0f8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.263688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:34.270824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.271693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.272220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.272708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.274090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.275783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.278115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:34 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:34.279354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.292000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786c19-6ea9-4484-91b4-d3961aec3e6f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.333344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.334686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.335242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.335706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.336994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=03241180d254413d9a4ba773b9dbfa9a) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:34.337797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.340236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.347378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 112/230] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:34 2022] GET /identity/v3/role_assignments?user.id=03241180d254413d9a4ba773b9dbfa9a&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:34.348381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.416151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c930af-487f-4237-bd1a-ca3c872d2c16 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.436366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:34.470453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.474074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.474397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.474706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] PATH_INFO: `/v3/users/e491d60c26ae402a9133f33871fa29f6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.477237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] RBAC: Authorizing `identity:get_user(user_id=e491d60c26ae402a9133f33871fa29f6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.478748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.482399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 119/231] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:34 2022] GET /identity/v3/users/e491d60c26ae402a9133f33871fa29f6 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:34.488533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.498436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5069c-5526-4920-93e9-40bc3d3b1139 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.568257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.568939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.569228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.569505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/e491d60c26ae402a9133f33871fa29f6/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.573327 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bad46ffb2934fa0a8cfc624b92a31b2, user_id=e491d60c26ae402a9133f33871fa29f6, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.575410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.603255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:34.619038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 113/232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:34 2022] PUT /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/e491d60c26ae402a9133f33871fa29f6/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:34.657249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbbb1a-26eb-4a96-af87-c1e6952f1d39 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.704201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514b6aa-e150-4cd5-8254-8b8ac7ee166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.705312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514b6aa-e150-4cd5-8254-8b8ac7ee166d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.705846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514b6aa-e150-4cd5-8254-8b8ac7ee166d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.706310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514b6aa-e150-4cd5-8254-8b8ac7ee166d None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.707749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514b6aa-e150-4cd5-8254-8b8ac7ee166d None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.709495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514b6aa-e150-4cd5-8254-8b8ac7ee166d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.711716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 120/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:34 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:34.719882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:34.879807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9ec3-dec9-41f5-8921-7d1808f52db4 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:34.911304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:34.919322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777abb90-233a-49be-bb11-b9d4c04ce4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:34.919997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777abb90-233a-49be-bb11-b9d4c04ce4c5 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:34.920281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777abb90-233a-49be-bb11-b9d4c04ce4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:34.920559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777abb90-233a-49be-bb11-b9d4c04ce4c5 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/e491d60c26ae402a9133f33871fa29f6/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:34.923139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777abb90-233a-49be-bb11-b9d4c04ce4c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bad46ffb2934fa0a8cfc624b92a31b2, user_id=e491d60c26ae402a9133f33871fa29f6, role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:34.924711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777abb90-233a-49be-bb11-b9d4c04ce4c5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:34.944836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 114/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:34 2022] PUT /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/e491d60c26ae402a9133f33871fa29f6/roles/df14a02f49874f9892c73d73eac93c84 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:35.577247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb773e5-d92f-4f55-b707-26c04c6795e9 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:35.577766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb773e5-d92f-4f55-b707-26c04c6795e9 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:35.577766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb773e5-d92f-4f55-b707-26c04c6795e9 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:35.579376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 121/235] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:35.584379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9117-b2ea-4adb-a93a-9a4a308fb9b5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:35.584770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9117-b2ea-4adb-a93a-9a4a308fb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:35.584934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd9117-b2ea-4adb-a93a-9a4a308fb9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:35.611272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b1bd9117-b2ea-4adb-a93a-9a4a308fb9b5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:35.612469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b1bd9117-b2ea-4adb-a93a-9a4a308fb9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:35.697044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 115/236] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:35.892371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ca2c-fc84-4e0c-852d-b7e615d83bd1 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:35.892655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ca2c-fc84-4e0c-852d-b7e615d83bd1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:35.892929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ca2c-fc84-4e0c-852d-b7e615d83bd1 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:35.894581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 122/237] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:35.899770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd36274-a813-4165-8d6a-143819934578 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:35.900060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd36274-a813-4165-8d6a-143819934578 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:35.900333 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd36274-a813-4165-8d6a-143819934578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:35.922268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1fd36274-a813-4165-8d6a-143819934578 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:35.923468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1fd36274-a813-4165-8d6a-143819934578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:36.003572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:36.085316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71ca2c-fc84-4e0c-852d-b7e615d83bd1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:36.217554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71ca2c-fc84-4e0c-852d-b7e615d83bd1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:36.261545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:36.262176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.262454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.262755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.268099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:36.271340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd36274-a813-4165-8d6a-143819934578 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:36.278720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:36.283743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:36.284619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:36.285954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 123/239] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:36.290755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:36.334963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:36.449791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874720ce-8047-4593-876a-a6f96eccda18 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:36.468662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd36274-a813-4165-8d6a-143819934578 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:36.494144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:36.494787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.495064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.495335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.496525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:36.496824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:36.498195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:36.517023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 124/240] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:36.522968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:36.539730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:36.540373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.540650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.540921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.543203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:36.544635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:36.546369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 117/241] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:36.555753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:36.664270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:36.678048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2b81f-0af8-4e6d-a3c7-e4ea0e71a304 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:36.691221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:36.728342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921dce-bdb9-46ed-b444-0df83e1447a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:36.729480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921dce-bdb9-46ed-b444-0df83e1447a3 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.730675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921dce-bdb9-46ed-b444-0df83e1447a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.731112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921dce-bdb9-46ed-b444-0df83e1447a3 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.732053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921dce-bdb9-46ed-b444-0df83e1447a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:36.734161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921dce-bdb9-46ed-b444-0df83e1447a3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:36.737913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a86a-8714-4072-81e4-b74bf98fb877 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:36.762804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 118/242] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:36 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:36.765620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a34e29-2614-44e8-8462-f40e174ed4c5 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.766439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a34e29-2614-44e8-8462-f40e174ed4c5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.766885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a34e29-2614-44e8-8462-f40e174ed4c5 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.769254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 119/243] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:36.776356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431973d-b1a7-4179-ab2e-07ee8cc63603 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.777032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431973d-b1a7-4179-ab2e-07ee8cc63603 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.777443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431973d-b1a7-4179-ab2e-07ee8cc63603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.783959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:36.784667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:36.785018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:36.785639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] PATH_INFO: `/v3/users/e5fc8ac0dea44efb9a0f3168104f55f2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:36.802976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a431973d-b1a7-4179-ab2e-07ee8cc63603 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:36.804691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a431973d-b1a7-4179-ab2e-07ee8cc63603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:36.805127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] RBAC: Authorizing `identity:get_user(user_id=e5fc8ac0dea44efb9a0f3168104f55f2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:36.806709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:36.810594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 125/244] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:36 2022] GET /identity/v3/users/e5fc8ac0dea44efb9a0f3168104f55f2 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:36.817026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:36.944907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 120/245] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:36.983423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90d87-3d49-43a7-817b-d7b35584a5ba None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:36.998828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:37.024315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.024932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.025210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.025481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.124719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:37.126242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:37.149314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bb14-9a88-4c7a-bf00-b4d042982f88 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.149620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bb14-9a88-4c7a-bf00-b4d042982f88 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.149874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bb14-9a88-4c7a-bf00-b4d042982f88 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.151382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 121/246] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:37.157966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.158252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.158528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.189827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:37.191044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:37.229652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:36:37.236415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.254882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:37.292501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 122/248] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:37.293245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.326281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:37.355985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53988e2-30eb-4049-b864-8276d9b15655 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:37.393038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.393679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.393956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.394228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.396236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:37.397704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:37.399406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 127/249] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:37.412405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.415490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d2f32-02d6-4370-81f9-ef017fc31da9 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:37.453939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.454591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.454899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.455169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.467014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:37.472054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:37.472934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:37.473730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 123/250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:37.482838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.513196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:37.536358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474348-569b-4b12-bf06-57913d7e6663 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:37.586914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.587638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.587980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.588323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.589248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] RBAC: Adding query filter params (role.id=b418af06458b470faa241952daffaf0a, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=e5fc8ac0dea44efb9a0f3168104f55f2) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:37.589708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:37.591202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80c6c9-3766-4338-9f79-cbb890c8e94b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:37.597161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 128/251] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/role_assignments?user.id=e5fc8ac0dea44efb9a0f3168104f55f2&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=b418af06458b470faa241952daffaf0a => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:37.598164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a5b8-04a8-4191-a593-0f0c4e0c77b2 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.598513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a5b8-04a8-4191-a593-0f0c4e0c77b2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.598821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a5b8-04a8-4191-a593-0f0c4e0c77b2 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.600178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 129/252] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:37.606437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.606745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.607051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.611016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:37.629660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:37.630936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:37.631460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe90562-a960-49ae-a8b9-53f27e1de39a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:37.693408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.694186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.694384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.694677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.695354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:37.695657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:37.697609 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:37.710857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 124/253] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:37.711785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.734130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 130/254] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:37.734962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.821280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:37.846985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb57a35-7f47-45df-a8c8-b1ab7a4f740e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:37.896322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.897201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.897645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.898053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] PATH_INFO: `/v3/users/03241180d254413d9a4ba773b9dbfa9a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:37.899377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=03241180d254413d9a4ba773b9dbfa9a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:37.900791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e281b-2196-4790-8acc-1eb1e25d32cb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:37.901140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:37.903698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 131/255] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/users/03241180d254413d9a4ba773b9dbfa9a => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:37.912250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:37.974549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:37.975588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:37.976076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:37.977176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.011761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:38.016772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:38.017865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:38.023345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 125/256] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:38.044043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.059598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325e31b-9b63-40a1-905c-d7ad1532f7d3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.077045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:38.097587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.098450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.098913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.099321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.100765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:38.102334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:38.104265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 132/257] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:37 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:38.110122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.130578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:38.201267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe2825-c4b5-497f-973c-9ce16f190841 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.237244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.237912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.238198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.238472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.238982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f8785-c539-4103-b53c-6f16278d33ff None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.240963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:38.241218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:38.242763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:38.252408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 126/258] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:38.253329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.282227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.283475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.284128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.284566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/03241180d254413d9a4ba773b9dbfa9a/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.287304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] RBAC: Authorizing `identity:create_grant(project_id=2bad46ffb2934fa0a8cfc624b92a31b2, user_id=03241180d254413d9a4ba773b9dbfa9a, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:38.288756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:38.333125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 133/259] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:38 2022] PUT /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/03241180d254413d9a4ba773b9dbfa9a/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:38.333669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.334844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:38.372381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a921-eef2-471d-81cf-27142c24c595 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.413916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.414941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.415483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.415973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.428077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:38.433930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:38.434862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:38.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:38.438193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 127/260] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:38.445041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.595182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:38.654913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbc992-eb14-4ed8-82f6-2c7a4699731b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.664892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a15bd-862d-48e3-aea6-6eb94321d6fb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.697515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.698517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.699692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.700161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] PATH_INFO: `/v3/users/e491d60c26ae402a9133f33871fa29f6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.701627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] RBAC: Authorizing `identity:get_user(user_id=e491d60c26ae402a9133f33871fa29f6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:38.703298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:38.705477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 134/261] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/users/e491d60c26ae402a9133f33871fa29f6 => generated 283 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:38.711049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.730997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:38.744894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.745516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.746507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.746931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.747611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:38.747998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:38.749305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:38.762720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 128/262] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:38.768257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:38.829202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a1cc-9b72-43b4-b389-423eba4cd538 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.877443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.878478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.878982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.879504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.892115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:38.909366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb0b9-9a1f-45eb-a733-163c7c7f402b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:38.948874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:38.949510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:38.949792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:38.950063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] PATH_INFO: `/v3/users/e491d60c26ae402a9133f33871fa29f6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:38.952037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e491d60c26ae402a9133f33871fa29f6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:38.953481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:38.957685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 129/263] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/users/e491d60c26ae402a9133f33871fa29f6 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:38.967294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:39.002389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:39.003892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:39.080056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:39.141357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 135/264] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:36:39.143505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41013edf-2851-456e-aa7a-ef9f26ef27e4 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:39.147606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:39.195725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:39.212190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:39.213133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:39.213630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:39.214092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:39.289347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501595a6-f254-44d6-9b31-04b22a5c94d9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:39.306629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:39.306629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:39.369601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:39.371190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:39.371296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:39.371759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:39.372220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:39.375412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:39.377181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:39.380940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 136/265] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:39 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:39.393980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:39.437253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 130/266] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:39.442346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:39.581380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261fe-dee5-41d6-9de1-b09e32c69886 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:39.624056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62287bcc-7159-42ab-8178-5c0c543d7c1c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:39.626680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:39.627326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:39.627599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:39.627865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:39.630449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:39.631923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:39.633773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 131/267] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:39 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:39.640003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:39.642920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:39.700656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:39.708528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:39.709169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:39.709428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:39.709699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:39.710436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=e491d60c26ae402a9133f33871fa29f6) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:39.711096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:39.712550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fc6b6-59b6-4c63-a124-9af60a9bcf89 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:39.730746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 137/268] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:39 2022] GET /identity/v3/role_assignments?user.id=e491d60c26ae402a9133f33871fa29f6&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:39.818501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e0eb-40ea-4a53-96b5-ba67efa88ef0 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:39.866833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:39.867473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:39.867750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:39.868018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:39.868781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] RBAC: Adding query filter params (role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=e491d60c26ae402a9133f33871fa29f6) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:39.869091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:39.873008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaabc30-58af-4671-aacd-201c1c86e98b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:39.887060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 132/269] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:39 2022] GET /identity/v3/role_assignments?user.id=e491d60c26ae402a9133f33871fa29f6&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=df14a02f49874f9892c73d73eac93c84 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:40.116914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90359f-d331-42fc-8cdb-d695c983de90 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.117424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90359f-d331-42fc-8cdb-d695c983de90 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.117497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90359f-d331-42fc-8cdb-d695c983de90 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.119070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 138/270] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:40.125114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aca80-23ee-4d9f-a61b-2f9c59d73bdd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.125402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aca80-23ee-4d9f-a61b-2f9c59d73bdd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.125742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aca80-23ee-4d9f-a61b-2f9c59d73bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.153336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b28aca80-23ee-4d9f-a61b-2f9c59d73bdd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:40.154530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b28aca80-23ee-4d9f-a61b-2f9c59d73bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:40.228960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 133/271] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:40.346047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b706-0392-4c6d-a948-e0b7360cf4c7 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.346356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b706-0392-4c6d-a948-e0b7360cf4c7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.346595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b706-0392-4c6d-a948-e0b7360cf4c7 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.347964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 139/272] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:40.354252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.355128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.355617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.380380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:40.381864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:40.404178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8b45-02c6-4aa1-a9eb-f499550a4b49 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.404497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8b45-02c6-4aa1-a9eb-f499550a4b49 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.404728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8b45-02c6-4aa1-a9eb-f499550a4b49 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.406653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 140/273] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:40.408055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:40.413169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.413449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.413728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.441588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:40.443835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:40.494760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 134/274] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:40.531290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 141/275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:40.531503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:40.638259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46afe6-6fa5-49e4-ae2a-fe8831b86a90 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:40.673445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:40.674072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.674351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.674633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.685223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:40.690156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:40.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:40.691844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 135/276] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:40.700466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:40.770105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:40.786439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:40.809924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b9bd-bf41-4166-8a35-101765001e78 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:40.811961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:40.849504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:40.850289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.850849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.851298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.852100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:40.852543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:40.854264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:40.866076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 142/277] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:40.867516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:40.903438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706643-3ee0-47df-87ab-193c7820834c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:40.938545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:40.939189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:40.939472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:40.939748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:40.940856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:40.942294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:40.943897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 136/278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:40.944655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:40.989913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74185-5795-400b-b55a-7dd5836b8169 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.023599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.024212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:41.024341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.024479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.024748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.035567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:41.040689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:41.041560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 143/279] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:41.044059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.044765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d59740-620c-4454-8b9f-1b964260c5af None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.067396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:41.077343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aceea-4c7a-4463-8abb-cf97ad8294bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.077969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aceea-4c7a-4463-8abb-cf97ad8294bc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.078247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aceea-4c7a-4463-8abb-cf97ad8294bc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.078518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aceea-4c7a-4463-8abb-cf97ad8294bc None admin] PATH_INFO: `/v3/users/e5fc8ac0dea44efb9a0f3168104f55f2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.079659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aceea-4c7a-4463-8abb-cf97ad8294bc None admin] RBAC: Authorizing `identity:get_user(user_id=e5fc8ac0dea44efb9a0f3168104f55f2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.081142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aceea-4c7a-4463-8abb-cf97ad8294bc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.082779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 137/280] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:40 2022] GET /identity/v3/users/e5fc8ac0dea44efb9a0f3168104f55f2 => generated 297 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:41.083934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b889067-723e-44a7-bd63-f02b345dd494 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.084276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b889067-723e-44a7-bd63-f02b345dd494 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.084558 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b889067-723e-44a7-bd63-f02b345dd494 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.085791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 138/281] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:41.087522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b889067-723e-44a7-bd63-f02b345dd494 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.146996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3a0b0-6600-40e7-85c1-ca95689a2ff2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.179424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.179949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.180224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.180492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.181119 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.182540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.189109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b889067-723e-44a7-bd63-f02b345dd494 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.209381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 144/282] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:36:41 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:41.210314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.240220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.240869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.241193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.241501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.242301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:41.242656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.244410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e199a-8ef2-4f92-b26c-2f3f3653e511 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.254556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 139/283] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:41.257188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f340-851a-429c-af87-c53032bf3534 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.257720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f340-851a-429c-af87-c53032bf3534 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.258239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f340-851a-429c-af87-c53032bf3534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.279746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2169f340-851a-429c-af87-c53032bf3534 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:41.281038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2169f340-851a-429c-af87-c53032bf3534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:41.285709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:41.307791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:41.330443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab31461-2f90-41de-bc79-c0e1681a5b64 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.362689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 140/284] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:41.371270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.371270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.371606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.371828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.372155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f340-851a-429c-af87-c53032bf3534 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.372968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.374419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.376080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 145/285] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:41 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:41.384225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.494048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f340-851a-429c-af87-c53032bf3534 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.518393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77c3a-b23d-43b1-96bc-25b764c26f3b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.540020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.540890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.541313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.541727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] PATH_INFO: `/v3/users/e49d0d81041849a1bc06cbfcec0752f9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.555401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:41.561449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] RBAC: Authorizing `identity:get_user(user_id=e49d0d81041849a1bc06cbfcec0752f9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.562283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.564929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 141/286] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:41 2022] GET /identity/v3/users/e49d0d81041849a1bc06cbfcec0752f9 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:41.566848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.567669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.568104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.568511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/e5fc8ac0dea44efb9a0f3168104f55f2/roles/b418af06458b470faa241952daffaf0a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.570577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bad46ffb2934fa0a8cfc624b92a31b2, user_id=e5fc8ac0dea44efb9a0f3168104f55f2, role_id=b418af06458b470faa241952daffaf0a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.570992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.572071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.589910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 146/287] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:36:41 2022] PUT /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/users/e5fc8ac0dea44efb9a0f3168104f55f2/roles/b418af06458b470faa241952daffaf0a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:36:41.655353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:41.670073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:41.714087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33c17-61e0-492c-809a-22601415f221 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.779565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.780113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.780385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.780654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.781387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, user.id=e49d0d81041849a1bc06cbfcec0752f9, scope.system=all) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:41.781694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:41.783174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:41.789328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 12 11:36:41 2022] GET /identity/v3/role_assignments?user.id=e49d0d81041849a1bc06cbfcec0752f9&scope.system=all&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:41.819737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089166-950e-4a4e-96b6-6022130b9a75 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:41.866316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:41.867393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:41.867895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:41.868375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:41.881102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:41.894971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:41.895930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:41.897320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:41.903026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:42.004454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:42.052655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b229c6-e0fe-4f7a-a7fd-2b4eb3e553bc None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:42.104227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:42.104834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:42.105143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:42.105414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:42.106080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:42.106377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:42.107777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:42.122297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:42.127881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:42.227911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:42.269201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8c6a0-0b96-4671-bca0-f4979929755f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:42.321604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:42.322243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:42.322521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:42.322818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] PATH_INFO: `/v3/users/03241180d254413d9a4ba773b9dbfa9a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:42.324517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] RBAC: Authorizing `identity:get_user(user_id=03241180d254413d9a4ba773b9dbfa9a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:42.325958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:42.327875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 148/291] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:42 2022] GET /identity/v3/users/03241180d254413d9a4ba773b9dbfa9a => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:42.333091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:42.473241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43391c-140f-4a1a-8fb3-8480386faa52 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:42.500953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:42.522016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:42.522665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:42.522949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:42.523220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:42.602090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:42.603502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:42.733751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:42.739444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:42.906004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa10c-2c25-4ea1-b7b2-2a08cf11c7fd None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:42.951277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825e6ea-1cce-4c6e-8414-018863a0ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:42.951906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e6ea-1cce-4c6e-8414-018863a0ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:42.952183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e6ea-1cce-4c6e-8414-018863a0ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:42.952455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825e6ea-1cce-4c6e-8414-018863a0ccd7 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:42.955280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825e6ea-1cce-4c6e-8414-018863a0ccd7 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:42.956730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825e6ea-1cce-4c6e-8414-018863a0ccd7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:42.958648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 149/293] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:42 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:42.965089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:43.001030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:43.092182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb00b5f-d385-4ada-9a35-1c8057c0870e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:43.145650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:43.146196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:43.146485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:43.146795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:43.147532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=03241180d254413d9a4ba773b9dbfa9a) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:43.147849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:43.149273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539ab2-85fd-473b-99f6-cb341fa3b903 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:43.155959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 145/294] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:42 2022] GET /identity/v3/role_assignments?user.id=03241180d254413d9a4ba773b9dbfa9a&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:43.781890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c774fb-4566-437a-ba4a-665fa3a78779 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:43.782387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be459c0-8667-4a92-acfe-b8ebc8947aee None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:43.782464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c774fb-4566-437a-ba4a-665fa3a78779 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:43.782562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be459c0-8667-4a92-acfe-b8ebc8947aee None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:43.782663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c774fb-4566-437a-ba4a-665fa3a78779 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:43.782733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be459c0-8667-4a92-acfe-b8ebc8947aee None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:43.783979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 150/296] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:43.784097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 146/296] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:43.789229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9b15f-49b3-4c6d-afed-61e1bc68c977 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:43.789512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9b15f-49b3-4c6d-afed-61e1bc68c977 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:43.789781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9b15f-49b3-4c6d-afed-61e1bc68c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:43.794264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21cdf-dc29-45ea-b8b2-76a61680fede None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:43.794540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21cdf-dc29-45ea-b8b2-76a61680fede None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:43.794833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21cdf-dc29-45ea-b8b2-76a61680fede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:43.803275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:43.817362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ecc9b15f-49b3-4c6d-afed-61e1bc68c977 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:43.818526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ecc9b15f-49b3-4c6d-afed-61e1bc68c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:43.820769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-11b21cdf-dc29-45ea-b8b2-76a61680fede None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:43.823027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-11b21cdf-dc29-45ea-b8b2-76a61680fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:43.895309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 151/297] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:43.913813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 147/298] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:44.005078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa32f9-cbce-495b-9d52-3e3a074d1def None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.005398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa32f9-cbce-495b-9d52-3e3a074d1def None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.005628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa32f9-cbce-495b-9d52-3e3a074d1def None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.007256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 152/299] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:44.012440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201475-e51b-4281-95ef-08cd7eb2f40f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.012894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201475-e51b-4281-95ef-08cd7eb2f40f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.013303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201475-e51b-4281-95ef-08cd7eb2f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.031973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9e201475-e51b-4281-95ef-08cd7eb2f40f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:44.033331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9e201475-e51b-4281-95ef-08cd7eb2f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:44.047711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.103594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 148/300] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:44.138294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633882db-ec58-489a-a270-f2e255c91cbf None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.138583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633882db-ec58-489a-a270-f2e255c91cbf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.138887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633882db-ec58-489a-a270-f2e255c91cbf None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.140464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 153/301] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:44.145405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.145703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.145981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.164693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:44.165172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633882db-ec58-489a-a270-f2e255c91cbf None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.165871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:44.241692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 149/302] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:44.243633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.274537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633882db-ec58-489a-a270-f2e255c91cbf None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.311131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.312166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.312643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.313111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.315286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.324924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.326006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:44.331084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:44.331962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:44.332739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:44.340269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 154/303] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:44.341867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.347549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5e352-2d70-4816-bb0e-192a9e74cf2e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.380978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.381919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.382200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.382471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.383644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:44.385172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:44.387411 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 150/304] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:44.391436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.450137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f7f3-92b1-4c49-bcdb-f2cafb6195d9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.483753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.484355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.484636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.484929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.485592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:44.485894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:44.487296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:44.495188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 155/305] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:44.499416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.512925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a461d5-ea97-468e-be4c-0fb65fb213fb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.545972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.546589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.546894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.547165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.556232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.557532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:44.563463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:44.564412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:44.565194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 151/306] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:44.570068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.578814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.600186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4118-3644-4a57-9412-471ed0b99c40 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.632234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.632830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.633109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.633381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] PATH_INFO: `/v3/groups` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.633989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:44.635441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:44.662636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 156/307] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Aug 12 11:36:44 2022] POST /identity/v3/groups => generated 229 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:44.662636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.671408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb90ca6-bcd1-40a4-ba6d-89d3599b5190 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.711408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.712062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.712348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.712626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] PATH_INFO: `/v3/users/24a7f4536dfe4a9c83558373cc4fb21d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.728494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=24a7f4536dfe4a9c83558373cc4fb21d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:44.730966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:44.738086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 152/308] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/users/24a7f4536dfe4a9c83558373cc4fb21d => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:44.738086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.763144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dbea9-5f66-4dbd-a3e2-0f6073f926fe None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.780550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.805116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.806413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.806722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.807786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.810205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:44.819543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:44.827644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:44.828661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:44.829517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 157/309] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:44.830238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.851843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73c44-bce2-4f1d-9a18-efd85c72c3d6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.892326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.892931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.893204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.893469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.894131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:44.894431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:44.895833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:44.908838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 153/310] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:44.908838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:44.948107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb102-5391-47cc-aa9a-9af865df42ab None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:44.985923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:44.986870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:44.987833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:44.988313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:44.989820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] RBAC: Adding query filter params (role.id=b418af06458b470faa241952daffaf0a, user.id=24a7f4536dfe4a9c83558373cc4fb21d, scope.system=all) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:44.990305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:44.992676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.000024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 158/311] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/role_assignments?user.id=24a7f4536dfe4a9c83558373cc4fb21d&scope.system=all&role.id=b418af06458b470faa241952daffaf0a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:45.001056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:45.017082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66500a99-03a5-4c6e-a3ed-687b7c04e8e3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.053762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:45.063000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:45.067402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.068196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.068573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.068942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.070123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:45.070466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.072748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.083966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 154/312] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:45.089990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:45.147424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5534d2-8e65-45d2-85af-e7b0ddf1711f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.184596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.185543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.185543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.185766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] PATH_INFO: `/v3/users/e5fc8ac0dea44efb9a0f3168104f55f2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.186932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] RBAC: Authorizing `identity:get_user(user_id=e5fc8ac0dea44efb9a0f3168104f55f2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.188364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.190244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 159/313] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:45 2022] GET /identity/v3/users/e5fc8ac0dea44efb9a0f3168104f55f2 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:45.195664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:45.215740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911b541-8a63-4d8d-b60f-4a6f6f20a271 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.259890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.260750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.261786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.262280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] PATH_INFO: `/v3/users/e49d0d81041849a1bc06cbfcec0752f9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.263874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] RBAC: Authorizing `identity:get_user(user_id=e49d0d81041849a1bc06cbfcec0752f9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.266375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.268775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 155/314] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:45 2022] GET /identity/v3/users/e49d0d81041849a1bc06cbfcec0752f9 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:45.274386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:45.319955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb01d1-3e6d-4b44-bedf-b89b67f44e68 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.330071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:45.335636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:45.362356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.363313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.363808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.364284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.383980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e75f6-4c1b-4537-ae3e-e49a71028776 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.421484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.422157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.422429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.422734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] PATH_INFO: `/v3/system/users/e49d0d81041849a1bc06cbfcec0752f9/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.424159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e49d0d81041849a1bc06cbfcec0752f9, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.426035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.440475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 156/315] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Aug 12 11:36:45 2022] PUT /identity/v3/system/users/e49d0d81041849a1bc06cbfcec0752f9/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:36:45.441580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.443675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.562382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 160/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:36:45.567781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:45.676672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191344-792b-4aae-aaec-741de1e7b7b5 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.696803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:45.713662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7bb8-866b-4a16-b0a2-aab02b252519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.714325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7bb8-866b-4a16-b0a2-aab02b252519 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.714623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7bb8-866b-4a16-b0a2-aab02b252519 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.714906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7bb8-866b-4a16-b0a2-aab02b252519 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.716022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7bb8-866b-4a16-b0a2-aab02b252519 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.717496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7bb8-866b-4a16-b0a2-aab02b252519 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.724246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 157/317] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:45 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:45.725594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:45.739355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:45.836805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039201bb-1d4d-4c53-8a13-ab600173ef10 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:45.880962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:45.881563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:45.881840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:45.882110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:45.882860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] RBAC: Adding query filter params (role.id=b418af06458b470faa241952daffaf0a, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2, user.id=e5fc8ac0dea44efb9a0f3168104f55f2) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:45.883165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:45.884599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d042-ea3c-4e4d-a17e-7435a498ee2a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:45.891371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 161/318] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:36:45 2022] GET /identity/v3/role_assignments?user.id=e5fc8ac0dea44efb9a0f3168104f55f2&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=b418af06458b470faa241952daffaf0a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:46.615150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a3d8-ca01-40ae-be9c-036eb158f95c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:46.615707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a3d8-ca01-40ae-be9c-036eb158f95c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:46.615707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4a3d8-ca01-40ae-be9c-036eb158f95c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:46.617061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 158/319] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:46.622693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407288d-16b2-4d3a-bf4e-403971753c7a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:46.622987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407288d-16b2-4d3a-bf4e-403971753c7a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:46.623266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407288d-16b2-4d3a-bf4e-403971753c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:46.641711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0407288d-16b2-4d3a-bf4e-403971753c7a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:46.642903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0407288d-16b2-4d3a-bf4e-403971753c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:46.710961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 162/320] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:46.933265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5261-8673-42e9-9ffa-7cab5d976e1e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:46.933578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5261-8673-42e9-9ffa-7cab5d976e1e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:46.933829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5261-8673-42e9-9ffa-7cab5d976e1e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:46.935342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 159/321] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:46.940216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:46.940658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:46.940813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:46.947263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:46.959798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:46.960971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:46.974724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5261-8673-42e9-9ffa-7cab5d976e1e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.035252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 163/322] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:47.079622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5261-8673-42e9-9ffa-7cab5d976e1e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:47.113995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:47.114626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.114925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.115196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.116286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:47.117712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:47.119468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 160/323] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:47.124870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.224275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8bc2b-6d26-4e10-8db0-86fa25ce730e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:47.252842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:47.258984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a016b6-f46c-4231-ba43-426b781f3065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:47.259648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a016b6-f46c-4231-ba43-426b781f3065 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.259928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a016b6-f46c-4231-ba43-426b781f3065 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.260200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a016b6-f46c-4231-ba43-426b781f3065 None admin] PATH_INFO: `/v3/groups` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.260934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a016b6-f46c-4231-ba43-426b781f3065 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:47.262907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a016b6-f46c-4231-ba43-426b781f3065 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:47.286686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 164/324] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Aug 12 11:36:47 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:36:47.302716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.365981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:47.418805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b42a0-a815-474f-ba3b-9c01c2c2efce None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:47.449713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a151f-ddbf-4907-876b-6669fb73edfc None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.450002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a151f-ddbf-4907-876b-6669fb73edfc None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.450320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a151f-ddbf-4907-876b-6669fb73edfc None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.451855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 165/325] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:47.457379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.457655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.457925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.466211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:47.466481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.466766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.467038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.477620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:47.478859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:47.483074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:47.488983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:47.489908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:47.491006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 161/326] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:47.497181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.569557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 166/327] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:47.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3de12-5798-4086-a567-f5cf2879000d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:47.639789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:47.657968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:47.658582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.658900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.659175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.659843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:47.660144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:47.661520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:47.671220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 162/328] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:47.677102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.793982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390b514-33fa-4fef-b5d0-2be70b1733cf None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:47.827607 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:47.846028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:47.846725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:47.847009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:47.847279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] PATH_INFO: `/v3/users/24a7f4536dfe4a9c83558373cc4fb21d` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:47.848457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] RBAC: Authorizing `identity:get_user(user_id=24a7f4536dfe4a9c83558373cc4fb21d)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:47.849168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.849898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:47.851676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 167/329] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:47 2022] GET /identity/v3/users/24a7f4536dfe4a9c83558373cc4fb21d => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:47.860035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:47.982974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fbda0-508b-405c-a97b-ee10ecdc4cfa None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:47.991051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ba48-232e-43f8-9013-46e66e9ced71 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:48.029082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:48.029980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:48.030259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:48.030531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:48.033762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:48.034418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:48.034725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:48.035008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] PATH_INFO: `/v3/system/users/24a7f4536dfe4a9c83558373cc4fb21d/roles/b418af06458b470faa241952daffaf0a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:48.036473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=24a7f4536dfe4a9c83558373cc4fb21d, role_id=b418af06458b470faa241952daffaf0a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:48.038031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:48.043752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:48.050674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:48.051623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:48.052539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 163/330] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:48.058008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:48.061306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 168/331] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Aug 12 11:36:47 2022] PUT /identity/v3/system/users/24a7f4536dfe4a9c83558373cc4fb21d/roles/b418af06458b470faa241952daffaf0a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:48.116054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:48.191669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8bf63-db6e-419f-a6fb-fd930a246d61 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:48.234746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:48.235698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:48.236182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:48.236661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:48.237339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:48.237642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:48.239054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:48.248761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 164/332] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:48.254106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:48.322578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:48.372174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b22a-7016-4ae5-bcba-7c1b77f27c3d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:48.408463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc872d2-6af2-490f-ab66-276a69deb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:48.409099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc872d2-6af2-490f-ab66-276a69deb27e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:48.409379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc872d2-6af2-490f-ab66-276a69deb27e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:48.409653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc872d2-6af2-490f-ab66-276a69deb27e None admin] PATH_INFO: `/v3/users/e49d0d81041849a1bc06cbfcec0752f9` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:48.410826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc872d2-6af2-490f-ab66-276a69deb27e None admin] RBAC: Authorizing `identity:get_user(user_id=e49d0d81041849a1bc06cbfcec0752f9)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:48.412333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc872d2-6af2-490f-ab66-276a69deb27e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:48.414257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 169/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:48 2022] GET /identity/v3/users/e49d0d81041849a1bc06cbfcec0752f9 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:48.420639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:48.537589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:48.540317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6e2e-29ff-495d-83e0-2051fd6a78ac None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:48.582891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:48.583504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:48.583777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:48.584051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:48.584777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] RBAC: Adding query filter params (role.id=ae415c84706a4f84a2ec0503e561cc73, user.id=e49d0d81041849a1bc06cbfcec0752f9, scope.system=all) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:48.585081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:48.586507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c23b-a85d-47c3-9916-1c1eed2d4cf2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:48.601595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 165/334] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 12 11:36:48 2022] GET /identity/v3/role_assignments?user.id=e49d0d81041849a1bc06cbfcec0752f9&scope.system=all&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:50.031320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e846f-1ed5-48f6-8336-7a8b54d1d520 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.031320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e846f-1ed5-48f6-8336-7a8b54d1d520 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.031320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e846f-1ed5-48f6-8336-7a8b54d1d520 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.032300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 170/335] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:50.037972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591882b-23ee-4730-b3aa-60f1dc70a029 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.038788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591882b-23ee-4730-b3aa-60f1dc70a029 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.039241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591882b-23ee-4730-b3aa-60f1dc70a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.063753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4591882b-23ee-4730-b3aa-60f1dc70a029 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:50.065288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4591882b-23ee-4730-b3aa-60f1dc70a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:50.152418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 166/336] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:50.525322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2195c-f57f-4fc2-90fe-4928a2ce8f18 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.526004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2195c-f57f-4fc2-90fe-4928a2ce8f18 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.526404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2195c-f57f-4fc2-90fe-4928a2ce8f18 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.528867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 171/337] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:50.544499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5efdf5-a0b2-41e4-889e-f32b99028bac None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.545002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5efdf5-a0b2-41e4-889e-f32b99028bac None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.546561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610c1f-d5fd-40f2-a89f-42e9027fdaf9 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.546860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610c1f-d5fd-40f2-a89f-42e9027fdaf9 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.547131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610c1f-d5fd-40f2-a89f-42e9027fdaf9 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.548590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 172/338] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:50.549134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10610c1f-d5fd-40f2-a89f-42e9027fdaf9 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:50.552334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5efdf5-a0b2-41e4-889e-f32b99028bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.590896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ff5efdf5-a0b2-41e4-889e-f32b99028bac None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:50.592079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ff5efdf5-a0b2-41e4-889e-f32b99028bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:50.679934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 167/339] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:50.681179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.681516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.681734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.700808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10610c1f-d5fd-40f2-a89f-42e9027fdaf9 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:50.727597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:50.728787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:50.737919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:50.739602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d653e-3f7a-4178-b538-02b98d220d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:50.740598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d653e-3f7a-4178-b538-02b98d220d86 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.740874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d653e-3f7a-4178-b538-02b98d220d86 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.741148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d653e-3f7a-4178-b538-02b98d220d86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.754276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d653e-3f7a-4178-b538-02b98d220d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b66d653e-3f7a-4178-b538-02b98d220d86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:50.759776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:50.760650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:50.762011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 173/340] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:50.763164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d8bfa-e3d3-4a00-835c-775eeb5831f3 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.763164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d8bfa-e3d3-4a00-835c-775eeb5831f3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.763311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d8bfa-e3d3-4a00-835c-775eeb5831f3 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.764946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 174/341] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:50.769789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d8bfa-e3d3-4a00-835c-775eeb5831f3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:50.775197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:50.890326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d8bfa-e3d3-4a00-835c-775eeb5831f3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:50.929122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:50.930063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.930536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.931135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.931969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:50.932407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:50.934482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b043d-dcf5-4851-9c0e-d99f2806d8b5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:50.944380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 175/342] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:50.946129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:50.946554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:50.946980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:50.956306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 168/343] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:50.957176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:50.967083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:50.968483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:51.051822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.059910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 176/344] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:51.064162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:51.209163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9978508-cb2e-4de4-b3d7-0a92e5e8ef18 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:51.267316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:51.267963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.268240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.268508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.269091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9913e-a273-4300-85fe-370af68293bc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:51.293682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:51.299971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:51.301104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:51.302266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 177/345] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:51.308324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:51.354938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612ed1c-9637-49b0-9618-4ad7ab137696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:51.356061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612ed1c-9637-49b0-9618-4ad7ab137696 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.357178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612ed1c-9637-49b0-9618-4ad7ab137696 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.357816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612ed1c-9637-49b0-9618-4ad7ab137696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.365913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.399479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.447075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f314-f768-4f00-ae12-560b58871bd3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:51.458758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612ed1c-9637-49b0-9618-4ad7ab137696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:51.460801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612ed1c-9637-49b0-9618-4ad7ab137696 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:51.491225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:51.491818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.492267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.492546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.493226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:51.493529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:51.495078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:51.508086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 178/346] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:51.510645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:51.582047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 169/347] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:51.585786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074450-bc81-4f7c-9889-efa16dd4621e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.586337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074450-bc81-4f7c-9889-efa16dd4621e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.586832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074450-bc81-4f7c-9889-efa16dd4621e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.588619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 170/348] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:51.590437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074450-bc81-4f7c-9889-efa16dd4621e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:51.645082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.647666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.659600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffca6-f79a-4683-a8d3-367d37828946 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:51.704454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:51.705093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.705373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.705649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.717816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074450-bc81-4f7c-9889-efa16dd4621e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:51.718885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:51.724360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:51.725314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:36:51.726122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:51.728673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 179/349] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:51.729491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:51.759552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9089e-46b9-452a-85ce-e88dc3694fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:51.760171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9089e-46b9-452a-85ce-e88dc3694fd0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.761646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9089e-46b9-452a-85ce-e88dc3694fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.761646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9089e-46b9-452a-85ce-e88dc3694fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.849074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9089e-46b9-452a-85ce-e88dc3694fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:51.851755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9089e-46b9-452a-85ce-e88dc3694fd0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:51.864435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313df9df-768d-404d-91d4-18ae96cb3a3d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:51.921190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.928461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:51.929110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:51.929383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:51.929652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:51.931421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:51.932644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:51.934862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 180/350] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:51 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:51.935438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:51.966048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:51.997599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 171/351] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:52.003342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.003665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.004733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.026291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:52.027452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:52.061728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a42eb-50b6-4da1-b30d-8368707cf138 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.106426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 172/352] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:52.107920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.113682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.114328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.114638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.114930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.128799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:52.135654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:52.137109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:36:52.137901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 181/353] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:52.141040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.210133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:52.244609 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e9605-8b47-4d04-b467-b0c255f4b058 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.259935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:52.279783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582dcc1-f62f-4566-8780-6e53693b4010 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.286265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.288728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.288728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.288728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.288728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:52.289001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:52.291245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:52.299854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 173/354] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:52.300135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.324079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce31e0-1af6-416f-a9ce-0fdc1d592087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.324704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce31e0-1af6-416f-a9ce-0fdc1d592087 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.325010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce31e0-1af6-416f-a9ce-0fdc1d592087 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.325247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce31e0-1af6-416f-a9ce-0fdc1d592087 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.332182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce31e0-1af6-416f-a9ce-0fdc1d592087 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:52.333672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce31e0-1af6-416f-a9ce-0fdc1d592087 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:52.335302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 182/355] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:52.336504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee6521-c8de-4fb8-a56f-a0b48d8aa276 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.336852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee6521-c8de-4fb8-a56f-a0b48d8aa276 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.337072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee6521-c8de-4fb8-a56f-a0b48d8aa276 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.338218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 183/356] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:52.339019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee6521-c8de-4fb8-a56f-a0b48d8aa276 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.430047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4314a-e83b-4935-b46c-f463a88ab8c7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.473074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee6521-c8de-4fb8-a56f-a0b48d8aa276 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.474533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.475203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.475483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.475754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.476867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:52.478285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:52.480741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 174/357] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:52.480741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.495568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:52.511998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.512544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.512828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.513101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.513769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:52.514073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:52.515483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebcf05-f61b-4db6-9f37-2d34ae3c7207 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:52.524450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 184/358] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:52.525695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.525984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.526259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.549283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:52.550800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:52.554670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:52.603176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb5b1b-c772-44f4-9f47-99d3a0df19a3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.633225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 185/359] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:52.634163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.646498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.647439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.647722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.647997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] PATH_INFO: `/v3/users/24a7f4536dfe4a9c83558373cc4fb21d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.649658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] RBAC: Authorizing `identity:get_user(user_id=24a7f4536dfe4a9c83558373cc4fb21d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:52.652019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:52.652814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 175/360] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/users/24a7f4536dfe4a9c83558373cc4fb21d => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:52.653565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.750381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:52.760128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f4f4c-b6bc-42c6-ab2b-1f4154de1d36 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.785264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a95e-3f41-4784-837c-8b31c96e6149 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:52.815427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.816715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.816995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.817559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.818307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:52.818899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:52.821263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:52.828373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 186/361] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:52.829541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.833189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:52.845082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:52.845722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:52.846000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:52.846270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:52.865998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:52.876820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:52.877741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:52.878557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 176/362] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:52.879272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:52.966910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedff964-8a1d-4b22-b746-8cca7712b9cc None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.014810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.015451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.015727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.015994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.017988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.019462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.020748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a58c4b-1c88-45ac-a3f1-684ae77d242a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.021035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 187/363] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:53.026995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.069795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.070412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.071700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.071700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.078458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.109019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.146128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf70488-0018-4dd7-89a5-159c8f752475 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.172620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.174258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.201810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.202441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.202754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.203023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.203771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] RBAC: Adding query filter params (role.id=b418af06458b470faa241952daffaf0a, user.id=24a7f4536dfe4a9c83558373cc4fb21d, scope.system=all) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:53.204065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.207572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.224664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 188/364] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/role_assignments?user.id=24a7f4536dfe4a9c83558373cc4fb21d&scope.system=all&role.id=b418af06458b470faa241952daffaf0a => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:53.226219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.318844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 177/365] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:53.319666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.371162 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.386543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aaa35-769f-4450-b170-e2cc053fa023 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.417382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.423529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.424152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.424434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.424709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.425633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:53.425941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.427522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.437973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 189/366] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:53.438854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.451787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7ee26-28cc-4485-9921-7b0fb14b0e4c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.493507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.494153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.494437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.494759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.507912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:53.513306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:53.514228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 178/367] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:53.515382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.565958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9a944-244a-4fc9-9c4f-c31956fb3e1e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.616758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.617517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.617803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.618076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.619499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:53.619499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.620592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.626521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 190/368] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=df14a02f49874f9892c73d73eac93c84 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:53.627086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.639021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.647598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384d8e2-33f8-4c12-b39f-d6a46e234c4d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.691073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.691875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.692269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.692613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.694001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.695598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.697479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 179/369] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:53.698416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.702348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.762578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582964d0-22a2-4473-ad7d-5cd2a4a2a7a4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.811713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.812338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.812629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.812895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.828114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392b7e-cc67-4cda-9c42-8b50b7f65107 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:53.874416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:53.875072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:53.875356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:53.875629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:53.876298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:53.876648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.877979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.888272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 180/370] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:53.889042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:53.918315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:53.920921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:53.922110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:53.999164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.032493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a17f82-d5df-4557-bf43-053413567e15 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.053616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 191/371] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:54.054676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.075140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.076096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.076537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.076959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.078274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.079882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.081627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 181/372] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:53 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:54.082544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.164318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df80de-20d5-4bc1-aaba-b5113fa1d289 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.184693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.191653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3948cd-7c8c-49b3-85bf-02c44d1ec5a1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.205067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.205663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.205940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.206211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.230522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.231532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.232031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.232508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.233752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.234052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.235783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.237613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 182/373] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:54.238526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.282526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.284247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.346021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c12c99-10e0-455d-b3a3-196bbc60f781 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.383476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.384454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.384928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.385404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.386976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:54.387505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.389136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.395155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 183/375] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:54.395877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 192/375] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:36:54.396487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.401198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.431305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.515118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbafc5-c956-4be4-89ef-fdec7fcffd5c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.555013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.556042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.556520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.557040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.559029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.561322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.562096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.563716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 184/376] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:54.571977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.633279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c762d-c0cd-47ca-84d9-8dc2b375c57e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.694863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.697255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.697771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.698252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] PATH_INFO: `/v3/projects/eb962a2585ab4e27ac665ceb80fa0708` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.700205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] RBAC: Authorizing `identity:get_project(project_id=eb962a2585ab4e27ac665ceb80fa0708)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.701901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.703767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 193/377] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/projects/eb962a2585ab4e27ac665ceb80fa0708 => generated 344 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:54.709668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:54.733784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.744675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cccb08-6672-4370-b243-668d1006420a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.796912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.797919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.797919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.798126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.801368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:54.801368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.801368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.811299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 185/378] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=df14a02f49874f9892c73d73eac93c84 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:54.914633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7fea-7c57-4b48-af46-e4e6085e730b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:54.941805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:54.952870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884025ae-3e0d-43f6-81f3-2da026b50f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:54.953420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884025ae-3e0d-43f6-81f3-2da026b50f37 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:54.953696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884025ae-3e0d-43f6-81f3-2da026b50f37 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:54.953966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884025ae-3e0d-43f6-81f3-2da026b50f37 None admin] PATH_INFO: `/v3/groups/b8ac746dcea14ca08c4265fb0f154f97` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:54.963336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884025ae-3e0d-43f6-81f3-2da026b50f37 None admin] RBAC: Authorizing `identity:get_group(group_id=b8ac746dcea14ca08c4265fb0f154f97)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:54.964860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884025ae-3e0d-43f6-81f3-2da026b50f37 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:54.966936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 194/379] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/groups/b8ac746dcea14ca08c4265fb0f154f97 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:54.972734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:55.080275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8355b-3c71-4031-bb98-3a42a5eb2775 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:55.080606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8355b-3c71-4031-bb98-3a42a5eb2775 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:55.080823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8355b-3c71-4031-bb98-3a42a5eb2775 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:55.082447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 195/380] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:55.087406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:55.087692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:55.087962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:55.089276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d844a-3c47-4638-825a-fa471f9a5d52 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:55.107602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:55.108793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:55.124207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:55.124815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:55.125099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:55.125437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:55.126169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] RBAC: Adding query filter params (group.id=b8ac746dcea14ca08c4265fb0f154f97, role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=eb962a2585ab4e27ac665ceb80fa0708) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:55.126482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:55.127956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:55.133823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 186/381] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:36:54 2022] GET /identity/v3/role_assignments?group.id=b8ac746dcea14ca08c4265fb0f154f97&scope.project.id=eb962a2585ab4e27ac665ceb80fa0708&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:55.217192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 196/382] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:55.616526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:55.649621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:55.742927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8864c-afbb-45e9-ad53-6f4f2a8622fb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:55.778521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc57762-439c-4519-bfc8-b6d0d46e79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:55.779184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57762-439c-4519-bfc8-b6d0d46e79b2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:55.779468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57762-439c-4519-bfc8-b6d0d46e79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:55.779743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57762-439c-4519-bfc8-b6d0d46e79b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:55.790210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc57762-439c-4519-bfc8-b6d0d46e79b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-1bc57762-439c-4519-bfc8-b6d0d46e79b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:55.795690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:55.796643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:55.797474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 187/383] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:55.802640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:55.926875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6cf7-85ac-4ea1-b193-8acf55a15d31 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:55.927200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6cf7-85ac-4ea1-b193-8acf55a15d31 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:55.927434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6cf7-85ac-4ea1-b193-8acf55a15d31 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:55.928768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 188/384] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:36:55.932289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e61b0-06bd-4eba-aaad-9d544820c7b2 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:55.934347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56548fd2-6313-4452-bfe9-711519304721 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:55.938038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56548fd2-6313-4452-bfe9-711519304721 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:55.938038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56548fd2-6313-4452-bfe9-711519304721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:55.955564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-56548fd2-6313-4452-bfe9-711519304721 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:55.957011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-56548fd2-6313-4452-bfe9-711519304721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:55.967739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:56.005887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:56.006500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.006810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.007086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.007753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:56.008055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:56.009431 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:56.028878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 197/385] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:56.031203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:56.054456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 189/386] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:56.170874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d1004-10bd-4562-ae21-ba0566ed98b8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:56.218040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:56.218690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.218992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.219248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.220396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:56.221872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:56.223937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 198/387] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:56 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:56.231755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56548fd2-6313-4452-bfe9-711519304721 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:56.252640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:56.349169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56548fd2-6313-4452-bfe9-711519304721 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:56.384225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:56.385218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.386242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.386758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.388068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:56.389698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:56.391892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 190/388] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:56 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:56.397276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:56.475248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:56.538080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a75ff3-5c73-47fa-b308-e79db8c1261a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:56.567854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:56.582120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53760a-c3d1-4519-b089-2e9285882070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:56.582825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53760a-c3d1-4519-b089-2e9285882070 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.583109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53760a-c3d1-4519-b089-2e9285882070 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.583389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53760a-c3d1-4519-b089-2e9285882070 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/groups/63029de9fc504259b1cb238647bf8d2a/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.585418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53760a-c3d1-4519-b089-2e9285882070 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b2fab78c442109d26a2199f9d88cc, group_id=63029de9fc504259b1cb238647bf8d2a, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:56.590651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53760a-c3d1-4519-b089-2e9285882070 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:56.614985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 199/389] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 12 11:36:56 2022] PUT /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/groups/63029de9fc504259b1cb238647bf8d2a/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:56.690143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:56.715608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81ca62-4614-40ef-8f9e-b6feb365acf8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:56.754138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:56.755198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.755720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.756194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.768978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:56.774639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:56.775543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:56.776460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:56.778913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 191/390] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:36:56.780830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1d8a0-5738-4d86-a12a-31a01064b069 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.781349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1d8a0-5738-4d86-a12a-31a01064b069 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.781811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1d8a0-5738-4d86-a12a-31a01064b069 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.783407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 200/391] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:56.785432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:56.799629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880f79-d551-421c-b07a-d565bafb688a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.799845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880f79-d551-421c-b07a-d565bafb688a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.800064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880f79-d551-421c-b07a-d565bafb688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.835626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-72880f79-d551-421c-b07a-d565bafb688a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:56.836886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-72880f79-d551-421c-b07a-d565bafb688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:56.923814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f32d8b-60a8-4e8b-9025-af1966a48885 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:56.938753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 201/392] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:56.962318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:56.963275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:56.963784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:56.964287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:56.965149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:56.965642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:56.967233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d687a-5766-46d7-b9f3-a9ff578c334b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:56.976210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 192/393] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:56.986679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880f79-d551-421c-b07a-d565bafb688a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.061926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:57.152036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880f79-d551-421c-b07a-d565bafb688a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:57.174633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076e3c-77b5-4d68-89d2-82b383dc2b36 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.174925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076e3c-77b5-4d68-89d2-82b383dc2b36 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.175202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076e3c-77b5-4d68-89d2-82b383dc2b36 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.177064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 193/394] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:57.181903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.182187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.182472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.198958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:57.202008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:57.202675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.202962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.203238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.204620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:57.206082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:57.207728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 202/395] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:56 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:57.215862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:57.217095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:57.220077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.333250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 194/396] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:57.333250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.428538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b981-cc03-4ed2-a6c9-ebd06ac8bac1 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:57.444225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:57.446826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8f4b-06d7-4d2f-960d-8b034de59776 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:57.479165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:57.487843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:57.489959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.491008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.491293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.501302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a31a22-0ef8-45b4-bf12-d905be54170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:57.502383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a31a22-0ef8-45b4-bf12-d905be54170a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.502835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a31a22-0ef8-45b4-bf12-d905be54170a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.503260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a31a22-0ef8-45b4-bf12-d905be54170a None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.504537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:57.504871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a31a22-0ef8-45b4-bf12-d905be54170a None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:57.506433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a31a22-0ef8-45b4-bf12-d905be54170a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:57.508499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 203/397] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:57 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:57.509406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:57.510317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:57.511724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 195/398] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:57.513402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7a6c-f852-4a24-841c-f73fe3f8d7c0 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.513689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7a6c-f852-4a24-841c-f73fe3f8d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.513957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7a6c-f852-4a24-841c-f73fe3f8d7c0 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.515263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.519267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 204/399] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:57.519267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7a6c-f852-4a24-841c-f73fe3f8d7c0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.645189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7a6c-f852-4a24-841c-f73fe3f8d7c0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:57.656624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595af12-dff4-43b1-a38b-42347b01304e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:57.684714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:57.685314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.685648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.685887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.686507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:57.686835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:57.688199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99273e-a567-408e-a472-3510fadf189e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:57.692413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:57.693071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.693351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.693628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/groups/63029de9fc504259b1cb238647bf8d2a/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.695881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e8b2fab78c442109d26a2199f9d88cc, group_id=63029de9fc504259b1cb238647bf8d2a, role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:57.696813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 205/400] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:36:57.697760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.698041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.698862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.702187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:57.716717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 196/401] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 12 11:36:57 2022] PUT /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc/groups/63029de9fc504259b1cb238647bf8d2a/roles/df14a02f49874f9892c73d73eac93c84 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:57.716996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:57.717456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.718238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:57.756732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:57.787512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:57.812121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 206/402] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:57.814210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.847218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3ab03-0398-43fb-99fa-754faad11766 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:57.895409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:57.895975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:57.896249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:57.896842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:57.919256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:57.924530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:57.925658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:57.926484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 197/403] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:36:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:57.933041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:57.999853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bba1b-e9a9-4194-bb02-eca4d09073ab None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.071862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.072510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.072787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.073056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.079276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.080720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.082712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 207/404] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:57 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.088051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.110410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf474e-9525-4b6a-b490-70702a6ceedb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.131232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.151040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.171916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.172522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.172799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.173068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.173730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:58.174030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.175667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.190781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 198/405] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:36:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.191612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.230093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b4b7-865c-42b8-876e-c40490711709 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.271825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.273054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.273677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.274154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.279329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.281420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.284261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 208/406] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.285247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.312032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835018-7044-49c3-ac18-cd4f039d4534 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.347140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.348142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.348643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.349117 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.360510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:58.365962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:58.366966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:36:58.367759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:58.370332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 199/407] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:58.371315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.394093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f58b2-453e-442f-b35a-460d9098612e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.395671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.406957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.434885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.435525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.435802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.436072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.437196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.438774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.440803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 209/408] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.441710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.481982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a623d7e-2e03-42ab-b97d-2f53f04309ae None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.518434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.519472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.522869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.522869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/groups/63029de9fc504259b1cb238647bf8d2a/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.522869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] RBAC: Authorizing `identity:create_grant(project_id=2bad46ffb2934fa0a8cfc624b92a31b2, group_id=63029de9fc504259b1cb238647bf8d2a, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.524084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.542173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 200/409] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 12 11:36:58 2022] PUT /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/groups/63029de9fc504259b1cb238647bf8d2a/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:58.542910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.555834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0d20-bfc7-4fb1-b926-de3dfcda351f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.597612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.598657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.599231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.599747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.600702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:58.601293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.603131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.613385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 210/410] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.619530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.661068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.744314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6732-c50f-441d-889e-ee1a26b3c5b8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.785372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.791621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.793426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.793906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.794355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] PATH_INFO: `/v3/groups/b8ac746dcea14ca08c4265fb0f154f97` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.795323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859efdb-a092-4065-af0a-fc5f845299fd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.795908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] RBAC: Authorizing `identity:get_group(group_id=b8ac746dcea14ca08c4265fb0f154f97)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.798871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.801247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 211/411] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/groups/b8ac746dcea14ca08c4265fb0f154f97 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.807000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.838069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.838742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.839547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.839819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:58.841613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:58.843101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:58.845059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 201/412] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:58.850860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:58.955097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:58.959458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6db72-b93f-462f-9681-b1dde44c23cb None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:58.997469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc340bb3-bf2b-47f6-af33-9aa6ffd24cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:58.998382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340bb3-bf2b-47f6-af33-9aa6ffd24cb3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:58.998797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340bb3-bf2b-47f6-af33-9aa6ffd24cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:58.999083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340bb3-bf2b-47f6-af33-9aa6ffd24cb3 None admin] PATH_INFO: `/v3/projects/eb962a2585ab4e27ac665ceb80fa0708` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.000212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc340bb3-bf2b-47f6-af33-9aa6ffd24cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb962a2585ab4e27ac665ceb80fa0708)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:59.001815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc340bb3-bf2b-47f6-af33-9aa6ffd24cb3 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:59.003843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 212/413] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:36:58 2022] GET /identity/v3/projects/eb962a2585ab4e27ac665ceb80fa0708 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:36:59.005070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feaaab-bd21-48a0-b46c-66e3152d4843 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.005350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feaaab-bd21-48a0-b46c-66e3152d4843 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.005620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feaaab-bd21-48a0-b46c-66e3152d4843 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.011020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 213/414] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:59.011948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feaaab-bd21-48a0-b46c-66e3152d4843 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:59.034101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1119-536e-4789-bbb8-0be92e27c93a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:59.079179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6172e1-283a-413e-89a8-6f480b033180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:59.079840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6172e1-283a-413e-89a8-6f480b033180 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.080117 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6172e1-283a-413e-89a8-6f480b033180 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.080386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6172e1-283a-413e-89a8-6f480b033180 None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/groups/63029de9fc504259b1cb238647bf8d2a/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.083261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6172e1-283a-413e-89a8-6f480b033180 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bad46ffb2934fa0a8cfc624b92a31b2, group_id=63029de9fc504259b1cb238647bf8d2a, role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:59.085484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6172e1-283a-413e-89a8-6f480b033180 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:59.107035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 202/415] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 12 11:36:58 2022] PUT /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2/groups/63029de9fc504259b1cb238647bf8d2a/roles/df14a02f49874f9892c73d73eac93c84 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:36:59.108652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.109101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.109525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.131699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:59.133156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:59.156876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:59.173700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feaaab-bd21-48a0-b46c-66e3152d4843 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:59.230374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 203/416] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:36:59.265258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:59.265939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.266224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.266502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] PATH_INFO: `/v3/projects/eb962a2585ab4e27ac665ceb80fa0708/groups/b8ac746dcea14ca08c4265fb0f154f97/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.271942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb962a2585ab4e27ac665ceb80fa0708, group_id=b8ac746dcea14ca08c4265fb0f154f97, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:59.273390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:59.297603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 12 11:36:59 2022] PUT /identity/v3/projects/eb962a2585ab4e27ac665ceb80fa0708/groups/b8ac746dcea14ca08c4265fb0f154f97/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:36:59.530505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:59.635642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b11f5-3ff0-4dee-9d8c-0086cce680e6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:59.682041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ffd19-18f5-4f7d-b937-92e410b6b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:59.682990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ffd19-18f5-4f7d-b937-92e410b6b97f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.683409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ffd19-18f5-4f7d-b937-92e410b6b97f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.683816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ffd19-18f5-4f7d-b937-92e410b6b97f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.699757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ffd19-18f5-4f7d-b937-92e410b6b97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-dd2ffd19-18f5-4f7d-b937-92e410b6b97f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:36:59.704781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:36:59.705815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:36:59.706792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:36:59.708619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 204/418] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:36:59.717923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:36:59.769908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:59.842865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3fb4-4dc7-4543-ba3c-3f6f30c3a150 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.843424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3fb4-4dc7-4543-ba3c-3f6f30c3a150 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.843424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3fb4-4dc7-4543-ba3c-3f6f30c3a150 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.845158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 205/419] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:36:59.850706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.851071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.851362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.872161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:36:59.872161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:36:59.879900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:36:59.887165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ef523-8e04-4f5b-b0b4-9ad3bc04e1b2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:36:59.949032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 206/420] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:36:59.983875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:36:59.984505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:36:59.984793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:36:59.985068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:36:59.985740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:36:59.986047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:36:59.987447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:36:59.999770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 215/421] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:00.005424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.141569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f8b1-2d77-42be-9917-cdf02b1e58b1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:00.190596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:00.191589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.192187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.192659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.213396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:00.283831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:00.285693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:00.313121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.426422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:00.437662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da843fb-a835-417a-be98-0c9b3b2fdaa3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:00.477496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:00.478520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.479041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.479560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.487620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 207/422] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:00.496186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.496917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:00.502814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:00.503714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:37:00.504509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:00.507238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 216/423] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:00.519581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.549778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:00.608851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbd35b-3654-4072-a030-5ed1ad4c1b2c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:00.644099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:00.644861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.645145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.645416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.646589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:00.649856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:00.650158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 208/424] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:00.657533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.717133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493371e-ed29-49e5-91f8-7e1bec509409 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:00.763896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:00.764515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.764794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.765072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.765739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:00.766105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:00.767521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b37228-a3ec-4f6b-b929-6684fb8baf52 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:00.776528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 217/425] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:00.777607 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72d274-a7a9-42e8-8171-07141a0f4352 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.778042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72d274-a7a9-42e8-8171-07141a0f4352 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.778295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72d274-a7a9-42e8-8171-07141a0f4352 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.783808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 218/426] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:00.784727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72d274-a7a9-42e8-8171-07141a0f4352 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.795626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c7f74-01f0-4be5-b15a-6c8208b508e1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:00.801645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:00.807007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:00.833865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd8542-5d39-431b-a09d-c7b7f93a4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:00.834636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8542-5d39-431b-a09d-c7b7f93a4c43 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.835027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8542-5d39-431b-a09d-c7b7f93a4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.835405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8542-5d39-431b-a09d-c7b7f93a4c43 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.836737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd8542-5d39-431b-a09d-c7b7f93a4c43 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:00.838313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd8542-5d39-431b-a09d-c7b7f93a4c43 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:00.840274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 209/427] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:00.841482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.846542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.847138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:00.869074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:00.871160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:00.906016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72d274-a7a9-42e8-8171-07141a0f4352 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:00.941667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 210/428] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:00.946710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:00.951954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:00.952801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:00.953229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:00.953757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.050091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafedb82-48d6-4155-bc21-c845aca09eb7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:01.065517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:01.074484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:01.076259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:01.092527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:01.111587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:01.112661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.113018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.113299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.114031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:01.114341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:01.115811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:01.128827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 211/429] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:01.190058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 219/430] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:37:01.195570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:01.329304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5797-62c2-4870-9032-ede62b8fa9c9 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:01.365532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:01.366170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.366453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.366764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] PATH_INFO: `/v3/projects/4e8b2fab78c442109d26a2199f9d88cc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.368006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] RBAC: Authorizing `identity:get_project(project_id=4e8b2fab78c442109d26a2199f9d88cc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:01.369442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:01.371952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 212/431] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:37:01 2022] GET /identity/v3/projects/4e8b2fab78c442109d26a2199f9d88cc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:01.377034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:01.395819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:01.453114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:01.518237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0098e9-655a-426c-a697-c200c502b1db None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:01.536014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413662f-3209-41bb-aa88-181973097a83 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:01.537122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:01.570141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699a0d-530e-4873-a112-f8986fc07976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:01.570928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699a0d-530e-4873-a112-f8986fc07976 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.571212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699a0d-530e-4873-a112-f8986fc07976 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.571483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699a0d-530e-4873-a112-f8986fc07976 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.572789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699a0d-530e-4873-a112-f8986fc07976 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:01.574289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699a0d-530e-4873-a112-f8986fc07976 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:01.578717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 220/432] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:37:01 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:01.578717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63a52-d243-4a54-9bde-901b6e9bbd7c None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.578717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63a52-d243-4a54-9bde-901b6e9bbd7c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.578717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63a52-d243-4a54-9bde-901b6e9bbd7c None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.579446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 221/433] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:01.583577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63a52-d243-4a54-9bde-901b6e9bbd7c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:01.587431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0836e-ce61-440f-8749-34de8d453c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:01.588093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0836e-ce61-440f-8749-34de8d453c97 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.588373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0836e-ce61-440f-8749-34de8d453c97 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.588653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0836e-ce61-440f-8749-34de8d453c97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.600574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0836e-ce61-440f-8749-34de8d453c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-a1d0836e-ce61-440f-8749-34de8d453c97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:01.606404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:01.607332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:01.608158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 213/434] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:01.608809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.610094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.610094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.629633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:01.631179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:01.718791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63a52-d243-4a54-9bde-901b6e9bbd7c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:01.728320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 214/435] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:01.730062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:01.764122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:01.769777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:01.770030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.770239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.770476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.771577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=4e8b2fab78c442109d26a2199f9d88cc) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:01.773328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:01.777578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:01.782525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 222/436] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:37:01 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=4e8b2fab78c442109d26a2199f9d88cc&role.id=df14a02f49874f9892c73d73eac93c84 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:01.855906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfedac-61b8-4ff9-923f-1e5f1ab8a575 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:01.895763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:01.896390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.896669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.896947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.897630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:01.897924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:01.899395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cdef6-eaf2-40e7-b421-98c6af67cef4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:01.909920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 215/437] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:37:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:01.915665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:01.966187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5358-64de-426a-94ab-18eb5885f3d4 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.966498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5358-64de-426a-94ab-18eb5885f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.966773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5358-64de-426a-94ab-18eb5885f3d4 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.968254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 216/438] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:01.973129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:01.973418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:01.973691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:01.981685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:01.995072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:01.996286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:02.058120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368b193-6472-4e2f-9a37-43d3b7286ade None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.076390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 217/439] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:37:02.077471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.095243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.095943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.096228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.096499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.104657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.187544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.188946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.206596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981c66-ca5c-433b-85c8-d17e324d3ad6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.245817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.251965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.252624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.252906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.253174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.263927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:02.268644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:02.269564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:37:02.270401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:02.274519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 218/440] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:02.275352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.307255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 223/441] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:02.313014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.364416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.382482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46136d-1a72-4dec-bf5a-1c7439d572df None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.410537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2772f7a-ba8c-4050-974c-24c044636df7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.415677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.416280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.416560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.416858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.417519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:02.417821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.419211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.427465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 219/442] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:02.428235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.448936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.449637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.449917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.450183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.451326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.452755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.454360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 224/443] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:02.455150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.469749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.526893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ff80-5bba-438d-a10c-da6e66aae6be None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.558955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248cb69-9e90-4711-a6d6-438ce0647c4c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.560603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.561227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.561508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.561781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.571508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:02.576673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:02.577604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:02.578410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 220/444] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:02.579110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.583776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.593858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.594466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.594774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.595045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.659480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.660911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.674230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.676292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733696-fe53-4ba7-a6c0-a03c5fae8851 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.709064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.709609 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.709891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.710165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.711326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.712740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.714311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 221/445] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:02.715171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.763235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 225/446] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:02.764226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.783495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.813058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d89a7-58a6-4145-a35d-842a8a10a5bf None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.845782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.846380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.846721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.847002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.847674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:02.847981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.849355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.861902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 222/447] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:02.861902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.866218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46e40a-ac87-400b-8854-59b3ad9b28c8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:02.882292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:02.914574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:02.915210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:02.915487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:02.915767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:02.918227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=ae415c84706a4f84a2ec0503e561cc73, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:02.918555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:02.920346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:02.937828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 226/448] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=ae415c84706a4f84a2ec0503e561cc73 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:02.938487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:02.972581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd58ad-6789-41b7-9721-a43f79868e38 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.011284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.011932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.012213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.012484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] PATH_INFO: `/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.013786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] RBAC: Authorizing `identity:get_project(project_id=2bad46ffb2934fa0a8cfc624b92a31b2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.015428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.021866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 223/449] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/projects/2bad46ffb2934fa0a8cfc624b92a31b2 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:03.022725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:03.025607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:03.046884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aaff9-a1ad-4a59-90c0-5ac3669bc0eb None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.085551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.086799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.086932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.087207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.138285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1727a7a-622f-46c2-a922-ff53b08f3add None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.143587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:03.170555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.172508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.183582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.184220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.184499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.185089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] PATH_INFO: `/v3/groups/63029de9fc504259b1cb238647bf8d2a` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.186467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] RBAC: Authorizing `identity:get_group(group_id=63029de9fc504259b1cb238647bf8d2a)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.188595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.190224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 224/450] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:37:03 2022] GET /identity/v3/groups/63029de9fc504259b1cb238647bf8d2a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:03.195867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:03.287362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:03.299939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 227/451] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:03.306211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:03.320059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291224a2-387c-42a1-b40c-8e094bf78e96 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.352009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.352601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.352878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.353148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.353864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] RBAC: Adding query filter params (group.id=63029de9fc504259b1cb238647bf8d2a, role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:03.354165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.355644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.361316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 225/452] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:37:03 2022] GET /identity/v3/role_assignments?group.id=63029de9fc504259b1cb238647bf8d2a&scope.project.id=2bad46ffb2934fa0a8cfc624b92a31b2&role.id=df14a02f49874f9892c73d73eac93c84 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:03.381868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:03.406087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2def2-7206-4b6c-ae4e-b4e3e1a16122 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.442178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.442864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.443118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.443393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] PATH_INFO: `/v3/projects/eb962a2585ab4e27ac665ceb80fa0708` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.444551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=eb962a2585ab4e27ac665ceb80fa0708)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.446011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.447690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 228/453] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:37:03 2022] GET /identity/v3/projects/eb962a2585ab4e27ac665ceb80fa0708 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:03.453906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:03.556756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754d8b-0d92-44db-8def-998d3a4ea418 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.591403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44dc2c-09ab-407a-85de-53992c898b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.592031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44dc2c-09ab-407a-85de-53992c898b2a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.592313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44dc2c-09ab-407a-85de-53992c898b2a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.592588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44dc2c-09ab-407a-85de-53992c898b2a None admin] PATH_INFO: `/v3/groups/b8ac746dcea14ca08c4265fb0f154f97` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.593684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44dc2c-09ab-407a-85de-53992c898b2a None admin] RBAC: Authorizing `identity:get_group(group_id=b8ac746dcea14ca08c4265fb0f154f97)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.595164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44dc2c-09ab-407a-85de-53992c898b2a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.596724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 226/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 12 11:37:03 2022] GET /identity/v3/groups/b8ac746dcea14ca08c4265fb0f154f97 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:03.602637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:03.706360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c92cc-02c8-496a-a15f-91e579e4e8a6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:03.739201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:03.739802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:03.740083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:03.740360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:03.741084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] RBAC: Adding query filter params (group.id=b8ac746dcea14ca08c4265fb0f154f97, role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=eb962a2585ab4e27ac665ceb80fa0708) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:03.741394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:03.742848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c98d-7efc-44e0-8129-5d85c51f85e6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:03.749294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 229/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 12 11:37:03 2022] GET /identity/v3/role_assignments?group.id=b8ac746dcea14ca08c4265fb0f154f97&scope.project.id=eb962a2585ab4e27ac665ceb80fa0708&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:06.166163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172ad38-9258-4d56-8003-e7d859d712ea None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.167025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172ad38-9258-4d56-8003-e7d859d712ea None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.167440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172ad38-9258-4d56-8003-e7d859d712ea None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.169176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 227/456] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:06.174368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b7995-8e34-4b38-983e-6ecdcd423e04 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.175166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b7995-8e34-4b38-983e-6ecdcd423e04 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.175829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b7995-8e34-4b38-983e-6ecdcd423e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.203566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-239b7995-8e34-4b38-983e-6ecdcd423e04 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:06.204966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-239b7995-8e34-4b38-983e-6ecdcd423e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:06.207209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:06.288224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 230/457] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:06.408193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8585e5-e0f9-4187-90a3-eeac70cf504c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.408704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8585e5-e0f9-4187-90a3-eeac70cf504c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.409121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8585e5-e0f9-4187-90a3-eeac70cf504c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.410822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 228/458] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:06.416117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.416706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.417122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.447673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:06.449421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:06.475255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7a791-f461-4236-a7b3-e884d0883ed8 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.475578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7a791-f461-4236-a7b3-e884d0883ed8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.475809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7a791-f461-4236-a7b3-e884d0883ed8 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.477350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 229/459] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:06.482312 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.482599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.482903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.506539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:06.513775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:06.517908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:06.558201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 231/460] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:06.615896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 230/461] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:37:06.640180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:06.743915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:06.784550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b7b8-87aa-43aa-97f8-5ac9566c86a3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:06.839286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:06.839929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:06.840212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:06.840487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:06.858745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:06.858745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:06.881708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:06.882642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:06.883500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:06.883500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:06.883500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:06.883500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 232/462] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:06.888766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:06.959840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.037879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659aec-a894-432b-bec0-6ca2228acfec None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.071222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:07.077578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.078185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.078465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.078770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.079423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:07.079725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.081088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.094697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f36e-a371-4f4f-91fe-418ed3fdb69b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.099572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 231/463] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:07.100218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.118062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:07.133530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.134154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.134430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.134731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.145391 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.146859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-bddd624d-a23b-4de4-bf7d-cb9e70214edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:07.161496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:07.162527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:07.163828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:07.163828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:07.163828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:07.163828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 233/464] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:07.164051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1616c-03ea-4af3-969a-93f9cd6d879c None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.164346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1616c-03ea-4af3-969a-93f9cd6d879c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.164435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1616c-03ea-4af3-969a-93f9cd6d879c None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.170677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 234/465] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:07.170677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1616c-03ea-4af3-969a-93f9cd6d879c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.213022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158c10-99a8-46cc-a285-60f3a5a9c84b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.248619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.249240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.249526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.249793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.259821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.261291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:07.276740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:07.277660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:07.278511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:07.278511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:07.278511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:07.278511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 232/466] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:07.278760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.283393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1616c-03ea-4af3-969a-93f9cd6d879c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.319608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47816cf4-b4a0-404d-a048-024a94cfd9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.320504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47816cf4-b4a0-404d-a048-024a94cfd9ed None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.320960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47816cf4-b4a0-404d-a048-024a94cfd9ed None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.321431 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47816cf4-b4a0-404d-a048-024a94cfd9ed None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.322277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47816cf4-b4a0-404d-a048-024a94cfd9ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.323966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47816cf4-b4a0-404d-a048-024a94cfd9ed None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.329247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:07.347783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 235/467] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:37:07 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:07.349352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871697e-5666-4444-b99f-058bc6523072 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.349640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871697e-5666-4444-b99f-058bc6523072 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.349913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871697e-5666-4444-b99f-058bc6523072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.369336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8871697e-5666-4444-b99f-058bc6523072 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:07.370633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8871697e-5666-4444-b99f-058bc6523072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:07.407272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c942c0-d5aa-4d98-a96f-0fa11da6fa87 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.456573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.457590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.458043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.462686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:07.462686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 236/468] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:07.464543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.464543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:07.464956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.467907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871697e-5666-4444-b99f-058bc6523072 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.470214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.496109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 233/469] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:07.503632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.614492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871697e-5666-4444-b99f-058bc6523072 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.632293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce436-22f5-4b7c-833e-2522b36aa409 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.634832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:07.651700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.652598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.652887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.653850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.653850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:07.654094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.656854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429eec-aa08-440b-a41f-168129d9e3c4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.671083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.671273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 237/470] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:07.672129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.672325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d2c9-f34b-4228-a839-c39e48fb7464 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.672608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d2c9-f34b-4228-a839-c39e48fb7464 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.672877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d2c9-f34b-4228-a839-c39e48fb7464 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.673206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.673669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.674073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 238/471] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:07.674739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.676711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.680315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.680315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.680315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.700296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:07.701479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:07.703421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 234/472] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:37:07 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:07.704469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.725770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:07.812189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 239/473] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:07.813360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:07.846410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c153d-d68c-479f-a29f-cb230380f74a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:07.898115 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:07.898756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:07.899039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:07.899316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:07.899955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:07.902223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:07.927887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 235/474] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:37:07 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:07.961748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbee7a0-1eae-49c9-a7c1-3cbe5a780f93 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:08.002078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:08.003050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:08.003524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:08.003991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:08.018233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:08.020061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:08.030210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:08.037097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:08.038242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:08.039306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:08.039306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:08.039306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.041192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 240/475] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:08.047483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:08.080810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:08.153050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:08.186270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846800c-0d70-43db-bcd7-51d57d03bced None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:08.231216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:08.231975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:08.232159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:08.232484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:08.233142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:08.233448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:08.236455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:08.253620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 236/476] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:08.258757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:08.274754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215615a6-da8a-4ca3-98e0-799e6caa2b26 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:08.328275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:08.328997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:08.329218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:08.329493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:08.330219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:08.332306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:08.343638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.sql.core [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 11:37:08.343638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 11:37:08.343638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [parameters: {'id': '6038f693882b411ab9e78fa72929888f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 11:37:08.343638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application result.read() Aug 12 11:37:08.360361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return ref.to_dict() Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:37:08.361289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application yield resource Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise self.value Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application session.commit() Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:37:08.362191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:37:08.367489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:37:08.368374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application result.read() Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:37:08.369191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [parameters: {'id': '6038f693882b411ab9e78fa72929888f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:08.370550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 11:37:08.373512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.376106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 241/477] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 12 11:37:08 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:08.377985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:08.378302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:08.416165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879017f-fe81-4bfb-8cee-1cf7bbeb0313 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:08.447499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:08.488615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00bb6-6acb-467c-8f59-5d534748743a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:08.498838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:08.499455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:08.499736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:08.500062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:08.500719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:08.502153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:08.528473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04a286-1284-44a3-9de3-563e1244e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:08.529100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04a286-1284-44a3-9de3-563e1244e1ea None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:08.529378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04a286-1284-44a3-9de3-563e1244e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:08.529677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04a286-1284-44a3-9de3-563e1244e1ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:08.539248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:37:08 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:37:08.548935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04a286-1284-44a3-9de3-563e1244e1ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-8d04a286-1284-44a3-9de3-563e1244e1ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:08.555445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:08.556438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:37:08.557806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:08.564437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 242/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:08.566850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:08.678528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748067c-02c5-401b-850b-de1e6ca04417 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:08.715194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:08.718028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:08.719008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:08.719506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:08.719979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:08.720945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:08.721518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:08.723280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96f25-1cdb-4633-a81e-86ba520ebc75 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:08.737378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 238/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:09.840357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e83b-4aa6-4d5a-a840-ffa4ef182dda None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:09.840875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e83b-4aa6-4d5a-a840-ffa4ef182dda None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:09.840875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e83b-4aa6-4d5a-a840-ffa4ef182dda None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:09.842649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 243/481] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:09.847410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945846-3267-4d1a-acb5-b4f8c67963c6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:09.848192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945846-3267-4d1a-acb5-b4f8c67963c6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:09.848670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945846-3267-4d1a-acb5-b4f8c67963c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:09.875621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-63945846-3267-4d1a-acb5-b4f8c67963c6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:09.876857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-63945846-3267-4d1a-acb5-b4f8c67963c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:09.964267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:10.049679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c166-78b8-4423-aaf9-db09ff1e52eb None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.049996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c166-78b8-4423-aaf9-db09ff1e52eb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.050238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c166-78b8-4423-aaf9-db09ff1e52eb None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.051997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 244/483] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:10.056865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.057163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.057477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.080521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:10.081743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:10.168208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 240/484] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:10.396151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c166-78b8-4423-aaf9-db09ff1e52eb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:10.482875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:10.553275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c166-78b8-4423-aaf9-db09ff1e52eb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:10.571982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:10.595895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:10.618675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303471a-7e87-4bbc-a8ee-d609b242b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:10.619309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303471a-7e87-4bbc-a8ee-d609b242b495 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.619586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303471a-7e87-4bbc-a8ee-d609b242b495 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.619894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303471a-7e87-4bbc-a8ee-d609b242b495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.633923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303471a-7e87-4bbc-a8ee-d609b242b495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-8303471a-7e87-4bbc-a8ee-d609b242b495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:10.639729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:10.640632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:10.641410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 245/485] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:10.642073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0cbc3-1f1c-4cb7-9e7e-034cead63adc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:10.642668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa88f-c9dc-466a-b7ef-11c813f86e01 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.642764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa88f-c9dc-466a-b7ef-11c813f86e01 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.643870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa88f-c9dc-466a-b7ef-11c813f86e01 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.648495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 246/486] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:10.649413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aa88f-c9dc-466a-b7ef-11c813f86e01 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:10.678914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b05e-1535-40cb-ba2d-507f373efc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:10.679549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b05e-1535-40cb-ba2d-507f373efc8a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.679948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b05e-1535-40cb-ba2d-507f373efc8a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.680228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b05e-1535-40cb-ba2d-507f373efc8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.691376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b05e-1535-40cb-ba2d-507f373efc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-3a94b05e-1535-40cb-ba2d-507f373efc8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:10.696373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:10.699061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 241/487] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:10.701050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.702735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.702735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.721056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:10.722465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:10.774228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aa88f-c9dc-466a-b7ef-11c813f86e01 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:10.797504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 242/488] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:10.798465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:10.825599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:10.826195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:10.826471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:10.826770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:10.827442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:10.827741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:10.829125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:10.846891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 247/489] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:10.848648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:10.852952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:10.935261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:10.937083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5218-bc63-49f0-bdfe-1618920680f2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.004393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.005894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.006424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.006877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.007959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:11.008805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.010401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.024681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 243/490] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:11.032401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.038943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f7747-0476-440f-b233-f6b7858b82cd None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.085366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.086301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.086659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.086940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.098794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.100229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-0b96c695-4d08-48d9-9c77-6420c46766d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:11.114381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:11.115325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:11.116831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:11.116831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:11.116831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:11.116831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 248/491] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:11.117053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a75d-abff-41a8-8934-520e99972081 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.117255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a75d-abff-41a8-8934-520e99972081 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.118141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a75d-abff-41a8-8934-520e99972081 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.118729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 249/492] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:11.123995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a75d-abff-41a8-8934-520e99972081 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.143909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e129f5-e31d-4f34-b725-7499281ebff7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.151693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.181031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.181663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.181945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.182246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.192255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.193694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-2dc59441-6bcf-4fda-8ceb-b619c4c1e9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:11.208766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:11.209671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:11.210538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:11.210538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:11.210538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:11.210538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 244/493] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:11.216211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.216499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.216776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.235219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:11.235579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.236451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:11.243766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a75d-abff-41a8-8934-520e99972081 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.279222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.279746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.280025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.280298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.280947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:11.281252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.282752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.294985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 250/494] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:11.295831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.306228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 245/495] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:11.307097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.394154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9b2c-5906-41b7-969c-1403cc592548 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.399448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.414082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e47ce7-0801-4b5c-b2f3-7bdcef231754 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.428998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdb73e-6b36-42b5-870f-8bf06e8954ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.429620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb73e-6b36-42b5-870f-8bf06e8954ed None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.429895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb73e-6b36-42b5-870f-8bf06e8954ed None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.430165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb73e-6b36-42b5-870f-8bf06e8954ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.440731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdb73e-6b36-42b5-870f-8bf06e8954ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b8bdb73e-6b36-42b5-870f-8bf06e8954ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:11.445453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:11.446350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:11.447603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 251/496] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:11.448784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d6d2-a592-4bf1-9218-3f9c597d7561 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.448784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d6d2-a592-4bf1-9218-3f9c597d7561 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.449188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825d6d2-a592-4bf1-9218-3f9c597d7561 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.455171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 252/497] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:11.455171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d6d2-a592-4bf1-9218-3f9c597d7561 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.460239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.460849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.461127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.461396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.462142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:11.462717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.464522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.471978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.476484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 246/498] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:11.477113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.562699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825d6d2-a592-4bf1-9218-3f9c597d7561 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.581907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206a90-cdc5-456a-a3e9-c4f31094c993 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.596681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.597302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.597585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.597857 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.604692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.606129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.614967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.615570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.615855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.616134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.616797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:11.617103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.618450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-8cd0fdb2-e9fb-4c39-ad42-a203b9caa5b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:11.619259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:11.620657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:11.621538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 253/499] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:11.622094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.622343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.622493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.631892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 247/500] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:11.632846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.640233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:11.641412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:11.646297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.705853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 254/501] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:11.706688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.716917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.741513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b0131-6306-4a17-b34c-25557236ae3f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.775286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.776403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.776667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.776938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.784147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.785563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:11.798122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:11.799066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 248/502] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:11.799994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.823848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015f9ca-6ba8-4c86-b78a-99d626b46afe None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.864501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.865341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.865633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.866165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.877706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:11.882657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:11.883704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:11.890036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:11.890832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:11.891249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 255/503] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:11.891249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:11.923883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5c807-d75e-41bf-ac71-622e95d34b17 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:11.962657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:11.963276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:11.963574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:11.963851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:11.964575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:11.964884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:11.966308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:11.969384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.003213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 249/504] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:12.004039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.007606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af64a81-f034-4a15-ac74-ee0e1779dcfd None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.041304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.042442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.042756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.043033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.053235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.054703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:12.069508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:12.070571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:12.071813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:12.071813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:12.071813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:12.071813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 256/505] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:12.071813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.104875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364470-79a8-44d9-b4c1-337db188fd12 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.129831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.138401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.139029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.139306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.139577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.140292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:12.140593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.142005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.159647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 250/506] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:12.160505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.168707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09eea7-2058-4bf5-962f-7cbce36418df None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.188118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.202470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.203103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.203384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.203661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.204382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:12.204687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.206054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.213754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 257/507] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:12.214527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.259203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c15fc4-ee6d-4d0d-9e6e-2d6e0c935746 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.293097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.293712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.293992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.294270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.304233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.305725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.313203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c341c-a888-4357-bf1b-f418d8581e43 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:12.320142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:12.321240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:12.322243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:12.322243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:12.322243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:12.322243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 251/508] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:12.322243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.347631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.348227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.348502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.348769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.361665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.403073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.421256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.422747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.431496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605edc-4d41-43af-872d-5e6e171ded51 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.465390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.465984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.466261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.466536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.467197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:12.467503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.468860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.479509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 252/509] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:12.480275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.524616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 258/510] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:12.525473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.577045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.580741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3301e-e6a6-4ecb-849b-0c87fc32df26 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.603519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.614049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.614593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.614906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.615181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.621586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82985a36-575f-4d1b-b2db-d76d8ae7ff03 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.655735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.656343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.656616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.656887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.667258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.668699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.680259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.681683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:12.683624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:12.684644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:12.685502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:12.685502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:12.685502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:12.685502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 259/511] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:12.685819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.784997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.786944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc930a-0734-4940-b494-9c7ec1b4d70a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.790530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 253/512] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:12.796901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.822367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.823047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.823332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.823609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.824248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:12.824549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.825973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.827383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:12.838155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 260/513] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:12.839003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.898056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b00fc6-7e9f-46f9-9f75-d7eeda3ff152 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.931086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.931709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.931990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.932272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.938807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050e56-d284-422a-a87c-75113b4ebe33 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:12.939221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.940409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:12.951984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:12.953362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 254/514] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:12.955012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:12.977263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:12.977881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:12.978159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:12.978429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:12.988096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:12.989557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:13.004511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:13.005421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:13.006264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:13.006264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:13.006264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:13.006264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 261/515] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:13.006474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.016415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.053974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.062059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f9bf8-2801-41f1-9a44-90ff5c98a528 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.094372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.095003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.095290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.095555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.096185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:13.096483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.097835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.106894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f7dfb-d29d-4533-bcfa-df17f0de578c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.108869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 255/516] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:13.109618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.145009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.145569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.145842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.146114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.156330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.157774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:13.171612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:13.172513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:13.173376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:13.173376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:13.173376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:13.173376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 262/517] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:13.173593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.206857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc60eb-d838-4e97-a5e5-9b2b834d7047 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.224971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.242338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.242964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.243249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.243523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.244153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.245597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.265208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 256/518] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:37:13 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:13.265991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.271834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09530437-7b4f-42a8-927f-ffb0dcf3442e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.280594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.313283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.314459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.315015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.315239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.315994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:13.316302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.317829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.358018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 263/519] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:13.358903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.394716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014372f-d3e7-49b4-a8d0-316ccf0aa912 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.434478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.435049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.436103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.436388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.437038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:13.437348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.438775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.453459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 257/520] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:13.454538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.476961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8b933-da71-4a5b-ac50-f9021a2de697 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.491482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.514689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.515477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.515859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.516234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.523695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.525244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:13.537342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:13.538480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:37:13.539668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:13.540280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 264/521] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:13.540739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.561634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.570447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae686-cb8f-4eac-ace1-ce2bdf2aafaf None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.607727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.608343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.608626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.608897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.609547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:13.609845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.611282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.627386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 258/522] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:13.627386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.653867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34cf3b-7a73-4ad7-9415-18d3984bcb35 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.691743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.692276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.692548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.692821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.720771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.729518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e31da1-7211-4597-9ac7-aceef312793c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.764938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.765125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.765599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.765881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.766157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.766392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.773039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.774450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.784288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:13.786793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:13.787926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 259/523] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:13.794344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.885196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 265/524] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:13.886807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.899938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fcad7-00e9-47e6-a26c-843ce5fd6cc2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:13.935269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:13.935876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:13.936163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:13.936439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:13.937172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:13.937478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:13.938934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:13.956716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 260/525] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:13.957446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:13.972510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.001422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406f83f-e43d-4cfb-b207-00230cfd5708 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.017804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.036339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.036960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.037232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.037499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.044634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.046062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:14.058125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:14.059101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 266/526] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:14.064652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.070475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aaa13-da10-44cb-86ee-6c8dfe34b76c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.108505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.109104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.109385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.109659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.110343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:14.110672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.112100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.130463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 261/527] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:14.131343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.170474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07736-599e-4a3a-b926-4b59808a2343 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.206386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.207090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.207314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.208149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.208878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.217967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.219446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:14.235172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:14.236208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:14.237058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:14.237058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:14.237058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:14.237058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 267/528] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:14.237058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.245405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb62418-e951-4855-a252-9f67f2910e6c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.266457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.282071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.282712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.282998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.283270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.345320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d20d5-0c70-4735-b855-699d46d66e73 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.353549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.355620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.396450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.397412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.397976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.398400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.399448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:14.399875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.402385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.422667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 268/529] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:14.424268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.443061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.478718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 262/530] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:14.479190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.530619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.546350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74c156-ba07-4267-9201-9bdf2a17d7c3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.583575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.584171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.584445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.584715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.585299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b58c6-088e-4cec-85b9-6c57b61e850d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.585493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=1b3bee55e837447180812b0f2bb2abd7) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:14.585722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.587286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.592772 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 269/531] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/role_assignments?user.id=1b3bee55e837447180812b0f2bb2abd7&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:14.599735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.624782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.625782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.626265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.626815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.627717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:14.628282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.629932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.648179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 263/532] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:14.649478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.686160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.731697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e4947-ba76-49ef-8ea2-f86e0fe85db9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.762784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbbeb-fde2-41a3-8c0d-86a2f356f334 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:14.770272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.770918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.771198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.771471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.772746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=a1335a28b21342d1afed40e182a524f3) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:14.773065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.774522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.782364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 270/533] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/role_assignments?user.id=a1335a28b21342d1afed40e182a524f3&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:14.784230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:14.827825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:14.828936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:14.830709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:14.831209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:14.832414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:14.855895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:14.858082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:14.891749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:14.892966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:14.898716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:14.898716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:14.898716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:14.898716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 264/534] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:14.903688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.005213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95d5c-fd91-4fc6-8e80-03e0498993c0 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.049366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:15.062386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245a80-3d19-4690-832a-afa0ead9da0f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.100385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.101128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.101406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.101676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.101859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.102651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.102939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.103218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.103872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:15.104715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.106095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.113185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.114677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.122203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 265/535] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:15.123432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:15.144422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:15.145504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:15.146519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 271/536] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:15.163630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.234540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996cba1-1323-4f9f-932d-d9db81b2fac3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.277401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.278639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.279026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.279394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.289238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.291054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-d22617d2-feab-4579-814c-56e0cc916cf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:15.306776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:15.307940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:15.308955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 266/537] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:15.309865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38584d1b-f1c4-4ce0-be09-2a6e22c85480 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.310212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38584d1b-f1c4-4ce0-be09-2a6e22c85480 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.310692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:15.310921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38584d1b-f1c4-4ce0-be09-2a6e22c85480 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.316868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 267/538] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:15.317674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38584d1b-f1c4-4ce0-be09-2a6e22c85480 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.322828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:15.336363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4ce0-573f-48e5-a47c-ddeb6f8dd2d9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.372727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.373697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.374042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.374377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.375173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:15.375546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.377756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1963db-9ce9-49ae-b8c8-584d37e07aee None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.394194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 272/539] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:15.395498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.395853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.396195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.419077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:15.420507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:15.424419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38584d1b-f1c4-4ce0-be09-2a6e22c85480 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.460611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.461311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.461596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.461975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.462717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:15.463027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.465007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.477845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 268/540] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:15.478478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.500757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 273/541] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:15.501675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.591046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:15.630568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:15.650376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb462873-e872-428d-94cc-feb9522e0405 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.691262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e1cb1-c1ea-4204-894e-c1e51eb2173f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.710495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.711134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.711413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.711687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.712418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=76127525ce2e45a3b53487d0f92014ff) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:15.712725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.714715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.721550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 269/542] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:15 2022] GET /identity/v3/role_assignments?user.id=76127525ce2e45a3b53487d0f92014ff&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:15.742906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.743667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.744051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.744418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.745295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=209260a51d244372a392acf3176e8303) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:15.745699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:15.747329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:15.753666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 274/543] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:15 2022] GET /identity/v3/role_assignments?user.id=209260a51d244372a392acf3176e8303&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:15.832019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:15.947663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8291-f633-4ded-823d-7de1ce9061d1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:15.979491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:15.985133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:15.985797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:15.986050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:15.986323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:15.997449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:16.003156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:16.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:16.005236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 270/544] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:16.010244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:16.117687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65eefb-3696-47a6-9283-58388b2005d3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:16.153707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:16.161486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:16.162103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.162469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.162744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.163415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:16.163719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:16.165088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:16.178246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 275/545] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:16.184215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:16.288975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6a276-7ffb-40e4-a72c-b37aa14cf3df None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:16.323493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:16.324116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.324394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.324665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.335382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:16.336819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:16.350901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:16.351835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:16.353283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:16.353283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:16.353283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:16.353283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 271/546] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:16.357978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:16.486630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bc2b6-8d0d-45fb-849e-27214a17c37c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:16.527700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:16.528310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.528585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.528852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.529493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:16.529833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:16.531220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:16.543735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 276/547] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:16.549285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:16.595412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:16.663182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6349ec-ea2b-4b24-92ef-2a1b84a19a83 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:16.710190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:16.710394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.710644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.710923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.721400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:16.722883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:16.738179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:16.739204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:16.741116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 272/548] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:16.745182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:16.813614 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:16.871392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbd00-54a3-4383-b41b-28774744e12c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:16.911115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:16.911718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.911992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.912261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.912987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:16.913286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:16.914802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d743063-ecdf-463a-807c-40691002b809 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:16.936838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 277/549] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 12 11:37:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:16.942463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:16.948630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927728c2-bc78-4350-980b-30eab9af01b8 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.949188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927728c2-bc78-4350-980b-30eab9af01b8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.949657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927728c2-bc78-4350-980b-30eab9af01b8 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.951462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 278/550] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:16.956737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98774-7ec6-4660-9181-04e850e9f423 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:16.957260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98774-7ec6-4660-9181-04e850e9f423 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:16.957848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98774-7ec6-4660-9181-04e850e9f423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:16.976496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-33e98774-7ec6-4660-9181-04e850e9f423 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:16.977949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-33e98774-7ec6-4660-9181-04e850e9f423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:17.110899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:17.115972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1353b5-eaef-4ebd-a0cd-84fb921eebb8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:17.118814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 279/551] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:17.137143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ede5-0346-4dad-85b9-1345aca15f5c None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.137427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ede5-0346-4dad-85b9-1345aca15f5c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.137701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ede5-0346-4dad-85b9-1345aca15f5c None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.139304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 280/552] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:17.144120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.144400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.144707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.162517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:17.163740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:17.189963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:17.191056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.191656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.192129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.203204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:17.237463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 281/553] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:37:17.326544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:17.328433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:17.468286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:17.472278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 273/554] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:17.477677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:17.563691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:17.618324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909773aa-222d-4e9f-a994-2e71408be17f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:17.653368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:17.654004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.654277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.654544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.664779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:17.666222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:17.681647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:17.682843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:17.684083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:17.684083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:17.684083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:17.684083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 282/555] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:17.684083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:17.703705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da9dd3-fbe3-4167-9d4a-3b4c9fe9eda8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:17.714947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:17.754156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:17.755086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.755198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.755470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.766429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:17.772321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:17.773254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:17.774568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:17.778228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 274/556] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:17.779098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:17.817880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b3f01-21c6-454a-aa38-54e1d812c93a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:17.846386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:17.873143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:17.874093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.875033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.875452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.889409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:17.896534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:17.897565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:17.899065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:17.899690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf890-5043-48a9-883d-4ee6558a3c89 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:17.907868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 283/557] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:17.908931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:17.944738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:17.945949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:17.946414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:17.947029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:17.948685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:17.949198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:17.951081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:17.966544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 275/558] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:17.967684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.014944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.037984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37dfc7-361c-4d33-a2a1-8d9a4a4ead6c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.080786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.081873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.082163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.082580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.083281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:18.083584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.084448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a0ae-fb9a-409a-bd8f-8e115116f4ae None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.084957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.093993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 284/559] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:18.094890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.111300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.127102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.127960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.128258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.128515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.129187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:18.129490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.130900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5e23-215c-4880-bac7-26762a1db125 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.138906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 276/560] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:18.140135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f7ca-622b-464d-95af-33563fb6aa55 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.140434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f7ca-622b-464d-95af-33563fb6aa55 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.140695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f7ca-622b-464d-95af-33563fb6aa55 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.145864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 277/561] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:18.145864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f7ca-622b-464d-95af-33563fb6aa55 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.208072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998ad50-d556-419b-b45d-c75d4106e9be None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.240477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.241090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.241367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.241638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.248429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f7ca-622b-464d-95af-33563fb6aa55 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.248685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.250116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:18.261947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:18.262928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 285/562] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:18.263810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.267010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.287394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.288020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.288302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.288572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.299068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.300495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-2aaa8613-47c5-478e-9147-4f7d99d88e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:18.315637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:18.316689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:18.317566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:18.317566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:18.317566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:18.317566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 278/563] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:18.317869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbaa6-ae05-455e-a8ef-cda2305851ff None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.318156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbaa6-ae05-455e-a8ef-cda2305851ff None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.318427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbaa6-ae05-455e-a8ef-cda2305851ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.335166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-99cfbaa6-ae05-455e-a8ef-cda2305851ff None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:18.336344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-99cfbaa6-ae05-455e-a8ef-cda2305851ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:18.362718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.366134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2deb09-38be-453e-8b32-2c091ca7db9c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.404184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.404184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.404184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.404184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.407076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 279/564] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:18.408100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef815d3-191f-4515-8fd9-0d42d6b6dc3b None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.408385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef815d3-191f-4515-8fd9-0d42d6b6dc3b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.408655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef815d3-191f-4515-8fd9-0d42d6b6dc3b None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.414039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 280/565] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:18.414039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef815d3-191f-4515-8fd9-0d42d6b6dc3b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.419084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.420526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:18.436830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:18.437787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:18.438714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:18.438714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:18.438714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:18.438714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 286/566] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:18.438714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.495362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.525186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef815d3-191f-4515-8fd9-0d42d6b6dc3b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.541273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7628d9-f95b-4fab-8506-4256438f1e9a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.563482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.564169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.564436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.564628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.565300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:18.565603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.567055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b198926-be53-4f07-ae60-2a90288865ac None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.577990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.578598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.578904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.583948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.584073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 281/567] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:18.584151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:18.584151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.584298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.584298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.584298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.584472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.593833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 287/568] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:18.594514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.604181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:18.605453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:18.623579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.678475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 282/569] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:18.679345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.699197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80a7a-b5db-4fba-8dd9-2f076b68272a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.717174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.736384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.737254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.737504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.737829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.738421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:18.738757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.740147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.752251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 288/570] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:18.753532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.797836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa6168-896d-4569-baa6-a9e3281f145d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.832043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.832650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.832927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.833208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.833925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=64379c68ad5d4aa989691e3dcbdb1900) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:18.834229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.835695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.841954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 283/571] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/role_assignments?user.id=64379c68ad5d4aa989691e3dcbdb1900&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:18.842823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:18.869016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:18.886502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d3fd0-b6d6-4c1d-90eb-a01d710471af None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.937202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:18.938248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:18.938773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:18.939887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] PATH_INFO: `/v3/users/glance` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:18.951995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:18.953964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:18.967212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:18.968245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:37:18.969212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:18.969758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9569c0-c8e6-435c-9562-c865510ff8e2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:18.970977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 289/572] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:18.973223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.009613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.011057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.011338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.011608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.013804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.024569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:19.031599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.032600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 284/573] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.038455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.082478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1eaa0-3707-4db2-9f47-dcb2883fd61e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.118848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.119630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.119796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.120067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.129039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.130775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.132674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:19.144966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.145977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 290/574] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:37:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.147381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.164098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45ab4-a5d8-41d3-b1a3-2bab1a88f424 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.222673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.223419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.223707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.223985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.234810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:19.240749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.241714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 285/575] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.243725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.264350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.271899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08e7da-fdd4-4414-b4b8-6453923e7969 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.308576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.309184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.309466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.309742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.310465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:19.310831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.312256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.330357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 291/576] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:19.335456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.349402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde7f8-ac04-44f2-85aa-561e7379df70 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.383744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.384344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.384624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.384899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.386105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:19.386412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.387820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.392795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.398916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 286/577] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:19.400615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.443248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d3af-7d95-48e8-b426-6566cd441ad2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.480295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.481322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.481322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.481493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.482142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:19.482448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.483913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.502358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 292/578] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:19.503349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.515959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a8d3-4302-4dff-a964-bfe686c20298 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.521684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.551856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.552568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.552851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.553125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.553786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:19.554089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.555465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.564198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 287/579] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:19.564924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.617078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ee371-7ba7-4ac4-8e98-387c512a4596 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.627290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.653297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.653917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.654191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.654456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.664527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.665959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.670081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d184fb-b512-440c-b3f6-c4f59bdf9fab None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:19.681544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.683247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:19.684140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:19.684140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.684140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:19.684140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 293/580] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.684363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.712598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.713520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.713805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.714079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.725080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.726635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:19.741656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.742849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:19.743928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:19.743928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.743928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:19.747839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 288/581] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.748650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.751602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.792878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af398df-7e75-487a-8180-b2ca7133dc37 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.829100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.830074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.830354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.830644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.842055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.843528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.852977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d786ef-fbbb-48fa-b1df-aefca3bd45ee None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:19.857395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:19.863342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:19.863342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.863342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:19.863342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 294/582] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.864060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.877568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:19.902000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:19.902644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:19.902930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:19.903204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:19.915690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:19.917484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:19.934202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:19.935428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:19.936344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:19.936344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:19.936344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:19.936344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 289/583] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:19.936344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:19.974528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ca76-5897-446f-9112-cc62e027ec6e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:19.992123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.013631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.014237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.014860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.014860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.015492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.015795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.017145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.029286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 295/584] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.030090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.044952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e71c-2781-4411-98ea-777aeb99436a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.078262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.078887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.079162 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.079436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.080067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.080367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.081719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.093829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 290/585] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.094990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.124575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.140023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4049c-eb5a-460a-af87-d155e7f0ef80 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.174785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.175379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.175919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.176187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.176819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.177115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.178465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.190266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 296/586] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.191243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.206106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56805e7d-9e9a-4bf1-a88f-b8e223087fd0 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.230335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.248088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.250786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.250786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.250786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.250786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.250786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.252260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.277679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 291/587] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.277679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.304413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6552a6d-16b6-4c42-b3df-0873c6c59593 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.339050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.339774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.340135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.340407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.347080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.348507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:20.359940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:20.360846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:20.361753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:20.365655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 297/588] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:20.366489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.367276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.384301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ff6f-1e55-442d-89a7-eebabbef3983 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.420436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.421122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.421403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.421675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.430012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.431445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:20.442905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:20.443870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 292/589] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:20.444883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.470266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.477617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787239-3edc-49bf-bf18-31f0fc866f01 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.513520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.514170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.514523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.514822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.521801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.523277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:20.535474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:20.536363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 298/590] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:20.542502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.558791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605987d-eca9-43c4-b15e-32a3fe24a059 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.596247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.596883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.597238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.597437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.605125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.606578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:20.617809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:20.618759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:37:20.620424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:20.623848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 293/591] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:20.624879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.634037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.659636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb369f3-03f2-4706-ba5a-341a9d7ac732 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.695165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.696086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.696621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.696891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.697574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.698499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.699940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.717479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 299/592] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.718129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.726973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f03a-7467-49a6-825d-e5a620144d6f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.736521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.763325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.763935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.764214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.764494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.765240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.765542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.766978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.783396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 294/593] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.784165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.819109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442d046-b4e8-446f-86da-7b9de946d9a7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.845710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.852397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.852993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.853265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.853536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.854241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.854540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.855977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.874597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 300/594] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.874597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.890929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155e880-7bef-4eea-9b63-d4a8733046b3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:20.923675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:20.924277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.924559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.924836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.925811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:20.926128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:20.927570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcfa48-2b04-4098-b1ef-3c99f3e67631 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:20.944332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 295/595] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:20.945516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95df49b-fac8-4f4c-be7d-0d469d7013f8 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:20.945751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95df49b-fac8-4f4c-be7d-0d469d7013f8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:20.946030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95df49b-fac8-4f4c-be7d-0d469d7013f8 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:20.947399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 296/596] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:20.951373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95df49b-fac8-4f4c-be7d-0d469d7013f8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:20.952170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:20.975409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1fdf3-d5ec-498a-9f4b-273fe63acf93 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.007168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.007815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.008087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.008359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/a1335a28b21342d1afed40e182a524f3/roles/79a1959b832e471fa2b0385028524292` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.022944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=a1335a28b21342d1afed40e182a524f3, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.024394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.038715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 301/597] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:20 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/a1335a28b21342d1afed40e182a524f3/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:21.039676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.054119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95df49b-fac8-4f4c-be7d-0d469d7013f8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.079574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:21.093068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.093713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.093994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.094263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.105806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.107305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:21.123867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:21.124910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:21.125852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:21.125852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:21.125852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:21.125852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 297/598] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:21.125852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.161372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1a40f-2586-4c60-a486-9b3f8d046226 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.194459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:21.206367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd5bcf-10b8-466f-8b81-e5cfbcdfe30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.206996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd5bcf-10b8-466f-8b81-e5cfbcdfe30f None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.207277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd5bcf-10b8-466f-8b81-e5cfbcdfe30f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.207553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd5bcf-10b8-466f-8b81-e5cfbcdfe30f None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/1b3bee55e837447180812b0f2bb2abd7/roles/79a1959b832e471fa2b0385028524292` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.222990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd5bcf-10b8-466f-8b81-e5cfbcdfe30f None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=1b3bee55e837447180812b0f2bb2abd7, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.224450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd5bcf-10b8-466f-8b81-e5cfbcdfe30f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.240183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 302/599] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:21 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/1b3bee55e837447180812b0f2bb2abd7/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:21.241406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.241693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.241970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.254993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96b99-c7a5-454b-a6e1-8613cdf5230a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.261569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:21.263110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:21.295263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.296147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.296500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.296953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.309687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.311269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:21.328236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:21.329271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:21.330172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:21.330172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:21.330172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:21.330172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 298/600] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:21.330882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.350835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 303/601] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:21.352554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.374917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:21.472368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35af38-4ff2-4714-90a0-cb2fd703ce5f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.481671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:21.495819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a890-56cf-4506-a990-2d3433d8abb0 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.515503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.516213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.516494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.516774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.517424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:21.517724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.519123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.537604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.538493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.539012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.539467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.540290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:21.540773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.542991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.554428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 304/602] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:21.558026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 299/603] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:21.562749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.567050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.679400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4413-2881-4910-971c-b989b85b65ec None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.734320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:21.746069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7edd0-3d87-4c81-bff9-5001cc4502ef None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.750923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.751563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.751841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.752113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.761933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.764238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:21.780486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:21.781416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:21.782309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 305/604] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:21.782833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.789043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.789686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.789968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.790287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.797883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.799530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:21.812201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:21.813120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 300/605] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:21.814040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.820901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:21.914207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c68688-6702-42a3-a083-8dbe25db0972 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.944206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8e5e-70df-4718-a3c5-f8b52651cbfb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:21.961227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.961971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.962252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.962522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.974232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:21.979924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:21.980880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:21.981724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 306/606] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:21.986440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:21.990557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:21.991206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:21.991491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:21.992614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:21.992614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:21.992891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:21.994286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.007901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 301/607] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:22.008714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:22.029719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:22.082490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:22.102283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ffdc8-ed55-4988-9980-1dc77a93517c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:22.138471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:22.139141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:22.139424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:22.139791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:22.140585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:22.140889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:22.142314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.143237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d23823-7352-4d74-8bd6-d7f3395262fb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:22.155826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 307/608] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:22.156632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:22.185625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:22.186701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:22.187208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:22.187724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:22.188744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:22.189245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:22.190912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.204452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 302/609] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:22.205652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:22.263840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b9d9-b845-4f86-88c4-dd67a1c71ae5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:22.292048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:22.303715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:22.304570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:22.304995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:22.305413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/209260a51d244372a392acf3176e8303/roles/79a1959b832e471fa2b0385028524292` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:22.321786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=209260a51d244372a392acf3176e8303, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:22.323729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.327436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:22.338167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57f831-1736-4d7f-9656-827e25673d54 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:22.344661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 308/610] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:22 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/209260a51d244372a392acf3176e8303/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:22.351637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:22.382056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:22.383087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:22.383588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:22.384003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/76127525ce2e45a3b53487d0f92014ff/roles/79a1959b832e471fa2b0385028524292` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:22.402217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=76127525ce2e45a3b53487d0f92014ff, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:22.404101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.424703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 303/611] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:22 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/76127525ce2e45a3b53487d0f92014ff/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:22.520712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ced01-6e97-4738-a8b3-f09b613c1886 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:22.565855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:22.566869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:22.567291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:22.567703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:22.581368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:22.583152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:22.602979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:22.604990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:22.607013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:22.607013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:22.607013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:22.609003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 309/612] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:22.618503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:22.742169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f92f-191e-4600-9f65-c22b49b39e70 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:22.765005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:22.789220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:22.789776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:22.790048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:22.790315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:22.790991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:22.791378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:22.792867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:22.805652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 304/613] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:22.811655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:22.878440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:22.958433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186874-0ff8-4635-9512-d369798ebc15 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:23.001047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:23.001676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.001951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.002217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] PATH_INFO: `/v3/users/swift` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.015852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:23.017364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2449c967-65d6-4f5f-aeed-7634d1fa431f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:23.031701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:23.032687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:23.033625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 310/614] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:23.042242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:23.164707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868d38-11c1-45e4-abea-ff4c1a05d1f0 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.165091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868d38-11c1-45e4-abea-ff4c1a05d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.165268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868d38-11c1-45e4-abea-ff4c1a05d1f0 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.168247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 311/615] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:23.173051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1626-d87d-4f48-98c8-cee1f3d7655b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.173340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1626-d87d-4f48-98c8-cee1f3d7655b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.173621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1626-d87d-4f48-98c8-cee1f3d7655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.196665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcb06-2346-4ac9-8d91-5bb25e432e59 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:23.208381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-918a1626-d87d-4f48-98c8-cee1f3d7655b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:23.209601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-918a1626-d87d-4f48-98c8-cee1f3d7655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:23.267228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:23.267850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.268135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.268412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.269146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:23.269453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:23.271037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:23.289876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 305/616] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 12 11:37:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:23.295907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:23.329865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 312/617] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:23.351866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:23.430320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e61b5e-5c31-4d71-9bcf-e3c92a9ff9af None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:23.452160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b3468-ca3b-4dbe-99ee-e826d5af71c5 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.453076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b3468-ca3b-4dbe-99ee-e826d5af71c5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.453554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b3468-ca3b-4dbe-99ee-e826d5af71c5 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.455195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 313/618] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:23.460387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.460387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.460687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.481482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:23.482425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.482929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.483432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.494082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:23.495588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:23.501823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:23.505894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:23.540351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:23.541357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:23.542323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:23.542323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:23.542323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:23.545893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:23.549928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:23.582977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:23.665136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:23.680376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45580878-052b-4097-9913-a6f9a0d79aaa None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:23.696278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 314/620] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:23.712567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:23.719983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:23.720403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.720683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.720955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.721598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:23.721900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:23.723289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:23.750218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 307/621] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:23.754161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:23.832126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffb80f-9f65-4d30-abc9-e09e06b495db None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:23.876252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:23.877307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:23.877786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:23.878337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:23.890059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:23.895105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:23.896085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:23.896934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:23.899899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 315/622] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:23.908297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:23.967014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:23.973368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709969a-abb7-48a9-8f40-5bc53f3b2a94 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.007136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.007763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.008045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.008321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.014955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.016389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:24.027678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:24.028625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:24.029502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:24.032048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 308/623] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:24.032742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.044539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.093958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c50c8c-02fe-4af8-9fcb-e3e5be9869be None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.130884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.131856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.132365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.132813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.133678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:24.134320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.136564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.138439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdb7f5-f38c-4987-96ac-1babd6939be8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.145446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 316/624] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:24.146597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.178932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.179686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.179932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.180205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.190943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:24.196371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:24.197284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:24.198714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 309/625] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:24.199414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.262147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.273048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c7275-7c5d-4db3-a614-a2dc81fd5ce6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.277369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.312890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.313131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900bef-eb2b-4eb1-b5d9-b913a96495cc None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.314414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.314926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.315492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.316381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:24.316885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.318515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.337325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 317/626] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:24.339071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.348154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.349164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.349164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.349337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.361415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.362937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:24.378414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:24.379451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:24.380356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:24.380356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:24.380356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:24.380356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 310/627] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:24.380356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.458791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5b043-33fe-4596-bfe7-e7e4f6e5dac4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.492790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881dac1-9b52-4f93-a9d6-c8c5d5aa33cc None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.496962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.497834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.498324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.498920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.499900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:24.500424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.502118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.515910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 318/628] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:24.516546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.518293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.528359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.529504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.529897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.530269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/64379c68ad5d4aa989691e3dcbdb1900/roles/79a1959b832e471fa2b0385028524292` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.537220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.548895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=64379c68ad5d4aa989691e3dcbdb1900, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.550541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.574655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 311/629] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:24 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/64379c68ad5d4aa989691e3dcbdb1900/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:24.574655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.656660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e016aa0-becb-4b2e-bc8e-2bc6ec1cdddc None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.699705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.700327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.700608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.700878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.701531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:24.701829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.703494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.723486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 319/630] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:24.725129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.799861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aea9b-0f47-4b3d-a858-960d7ddd4b15 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.810317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.835223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.835854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.836135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.836405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.843824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6943f-1daa-4d58-9bd6-a70889e962b2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:24.847265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.848699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c1051318-eb35-47b0-a2a1-2f600266a45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:24.865943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:24.867171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:24.868313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:24.868313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:24.868313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:24.868313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 312/631] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:24.868723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a78fb-4ae5-41f5-bea0-3404e370dd5f None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.869012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a78fb-4ae5-41f5-bea0-3404e370dd5f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.869289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a78fb-4ae5-41f5-bea0-3404e370dd5f None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.870714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 313/632] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:24.875715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7be20-99c3-46f5-a4af-00d46a1edf75 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.876004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7be20-99c3-46f5-a4af-00d46a1edf75 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.876281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7be20-99c3-46f5-a4af-00d46a1edf75 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.878657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 314/633] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:24.878921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7be20-99c3-46f5-a4af-00d46a1edf75 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:24.889103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:24.889741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.890022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.890297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.899255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:24.901316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:24.907936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-bf2adad2-998e-49a7-a45b-55a13b4def18 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:24.913213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:24.914147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:24.915125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 320/634] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:24.916792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2891b3b-9f33-4a0f-aace-b984e3f1f1dd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:24.916792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2891b3b-9f33-4a0f-aace-b984e3f1f1dd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:24.916957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2891b3b-9f33-4a0f-aace-b984e3f1f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:24.935249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b2891b3b-9f33-4a0f-aace-b984e3f1f1dd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:24.936446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b2891b3b-9f33-4a0f-aace-b984e3f1f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:24.997744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7be20-99c3-46f5-a4af-00d46a1edf75 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.008995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 321/635] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:25.010288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.010576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.010879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.036671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:25.038289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:25.043414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.044249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.044667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.045087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.045881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:25.046331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.047958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.062561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 315/636] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:25.063696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.130529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 322/637] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:25.130529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.170714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.185533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.218391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff6eb-1a4a-4745-9bdc-99e998501f64 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.235575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e9f4-f807-4f41-90f2-8d8ff7ee545d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.268150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.268758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.269026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.269299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.270021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:25.270322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.271915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.275380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.276845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.277337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.277881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.285870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.287838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.290256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 316/638] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:25.296623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:25.301759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:25.302741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:25.303679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:25.306303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 323/639] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:25.311615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.414261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747970-9e1a-4cbd-891d-178910793baa None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.449186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.451898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.453101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.453388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.453661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.455684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3163a-44b0-4cf1-a685-582a71e030ca None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.467231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.502853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.503544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.503747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.504458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.505196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:25.505509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.507700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.527356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 324/640] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:25.528295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.540983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.542672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.639660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203db27-ace0-4bd3-bcb7-b7f83e5ef62e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.651763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 317/641] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:37:25.651763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.656828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.682988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.683611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.683888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.684158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.693974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.695837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:25.702044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:25.703029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 325/642] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:25.703889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.764540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec26c8-11e1-4477-b1f6-f3405cdb103d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.801621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.802143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.802419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.802714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.812557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea364a6-6f56-4fac-92e9-7f6c830fa8c3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.813550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:25.819086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:25.820129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:25.820997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:25.822300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 318/643] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:25.823895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:25.850133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.850763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.851044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.851316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.897847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.928892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:25.932633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5790da-697f-4675-b81a-e35426d7e848 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:25.935296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.936753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.971274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:25.971832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:25.972119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:25.972401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:25.982981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:25.984814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:25.999983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:26.001124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:26.002384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:26.002384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.002384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:26.002384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 319/644] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:26.002384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.050186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 326/645] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:26.051536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.109580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d4a4-c280-417a-a8fd-bf0a6da58a7c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.127153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.143882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.144481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.144774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.145042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.145743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.146050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.147447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.155734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 320/646] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.156528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.164813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5778f-3955-4578-813b-ecba1b31889d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.174853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.205338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.206037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.206309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.206592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.207263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.207562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.208907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.217284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 327/647] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.218069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.271694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87191043-8606-4122-b9b3-9bb39c8b226a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.307911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.308781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.309253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.309746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.310690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.311159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.312796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.318487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5372-448f-43f5-b160-10b129b5b2d9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.326468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 321/648] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.327462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.352695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.358852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.359565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.359845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.360122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.371095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.372528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:26.387333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:26.388265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:26.389152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:26.389152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.389152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:26.389152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 328/649] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:26.389152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.410903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.437316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949c09f-0170-4d59-b532-4b13b769a47e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.474701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.475332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.475617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.476239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.491459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.493611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.499148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe434-b544-4208-b1f8-54a0c5affe60 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:26.512911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:26.513921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:26.514881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:26.514881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.514881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:26.514881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 322/650] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:26.515105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.542115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.542783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.543097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.543377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.554441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.556299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:26.571540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:26.573294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:26.574410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:26.574410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:26.574410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:26.575167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 329/651] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:26.575671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.614956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.627432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4f3d8-be70-445b-ab8f-9221077626f6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.652292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.661696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.662319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.662599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.662901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.669414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.670867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:26.682353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:26.683413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:26.684406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:26.684850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff25e9-19c8-455f-aeca-6085fd4f171d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.684932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 323/652] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:26.684932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.718767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.719624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.720078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.720359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.721003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.721310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.722696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f869-513f-4581-9c77-85ac1757238d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.734111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 330/653] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.735276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48161-464a-4b9b-80a0-4c54e1d33074 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.735562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48161-464a-4b9b-80a0-4c54e1d33074 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.735838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48161-464a-4b9b-80a0-4c54e1d33074 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.738644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 331/654] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:26.738644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48161-464a-4b9b-80a0-4c54e1d33074 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.784546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e68da-2fdf-4c9c-9f72-f274c55d71c4 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.817046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.817648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.817929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.818203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.818871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.819174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.820563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.830377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.836363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 324/655] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.836363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.841600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48161-464a-4b9b-80a0-4c54e1d33074 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.876089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.876704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.876994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.877254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.877921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.878222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.879618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.882052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:26.891564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 332/656] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.892400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:26.938568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9872a3-6abe-4262-928c-7c49001b00c3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:26.971672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:26.972278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.972561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.972838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.973523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:26.973831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:26.975345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fae9e-5053-47a7-8272-c5bf45dd914f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:26.986932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 325/657] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:26.988043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:26.988333 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:26.988613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:26.990638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80118-a7cd-4a0f-bc1c-2d1ee38db3d6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.006768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:27.007967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:27.024711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.025402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.025713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.025982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.032368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.033785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:27.045345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:27.046417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:27.047399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 333/658] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:27.047891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.067950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.152836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199c5dc-9063-44de-a12f-accbc2bc6fba None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.187676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.188304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.188588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.188871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.190206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 326/659] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:27.191209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.196389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.197913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:27.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:27.209923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 334/660] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:27.211292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.233051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.291122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.302916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8b0b6-395a-4a1d-83b2-3f23780f73d9 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.317335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f3e4d-ae0a-4f1c-bd92-9c46b364f27a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.340831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.341396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.341935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.341935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.348891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.350315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.353462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.354109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.354389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.354718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.355444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=a1335a28b21342d1afed40e182a524f3) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:27.355753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.357185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:27.361478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:27.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:37:27.372517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:27.373187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 335/661] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/role_assignments?user.id=a1335a28b21342d1afed40e182a524f3&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:27.373187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.373323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 327/662] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:27.373323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.487376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.497338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98640c0a-d10d-4a5b-8717-e2241f0831ae None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.504193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f9404-444f-4647-8a9e-a78db7472216 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.540602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.541948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.542231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.542508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.543275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:27.544169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.544273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.544786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.545000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.545097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.545319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.546003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:27.546305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.547756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.560147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.563506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 336/663] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:27.564362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.565342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 328/664] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:27.566400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.676734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3a63-249b-45db-b0e6-44dd5e4ed4cd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.680838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074da63-8fc8-4bd4-b775-3a6d49cae42a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.716093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.716502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.716733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.717005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.717121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.717277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.717373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.717623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.718340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:27.718666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.720109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.729262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:27.733896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:27.734873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:27.735729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 329/665] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:27.736424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.748146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 337/666] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:27.748146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.756438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.807614 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:27.847617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166391b-062c-4a83-be2c-ac9b3cecdf35 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.854396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707085bc-f25a-4cb6-890d-44532adbafdc None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:27.894632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.894632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.894632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.894632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.895087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=1b3bee55e837447180812b0f2bb2abd7) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:27.895087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.895087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:27.896343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:27.896954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:27.897235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:27.897510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:27.899852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 330/667] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/role_assignments?user.id=1b3bee55e837447180812b0f2bb2abd7&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:27.907942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:27.995481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:27.997026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.004234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.047030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6596-1506-4b67-b23d-fb5a92246dfb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.088436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.089451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.090161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.090350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.090944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.092167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:28.092167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.093430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.106434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 331/668] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:28.106434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.141588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 338/669] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:28.142544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.219657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2068f8-9399-4b70-a64e-7417cd58ef39 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.255227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.255758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.256035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.256305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.268429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.273794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321b34-e02a-47bf-ba60-909d52e6a15d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.322864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.323490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.323763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.324030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.336622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.338570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.341301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.343001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:28.353510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:28.355100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:28.356008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:28.356008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:28.356008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:28.356593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 339/670] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:28.357311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.373063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.470533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 332/671] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:28.471797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.488714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7fa6-6d5d-4b7b-8e3a-438590307e86 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.519122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.525568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.527077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.527359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.527708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.540889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.543584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:28.560942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:28.562392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:28.563395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:28.563395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:28.563395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:28.563395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 340/672] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:28.563641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.583800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9d53-d97d-465d-adf4-a33bfee42bf8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.617714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.618707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.619192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.620219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.621058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:28.621558 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.623213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.627767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.636310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 333/673] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:28.637860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.672318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f96b9-2b67-45a4-82eb-1b8cb4c3f658 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.708437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.708971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.709249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.709518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.720519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.722173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:28.737134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:28.738053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:28.738979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:28.738979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:28.738979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:28.738979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 341/674] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:28.739604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.746467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e04920-bb7b-4b87-8b54-fde584a80010 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.770911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.781538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.783511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.783511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.783511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.784015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:28.784514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.786069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.798588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 334/675] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:28.799739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.845969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a8f6-93cf-4006-98c7-66d11d7ecba5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.866565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:28.896187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.897079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.897502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.897918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.902681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b10f5-21a5-4cb9-8ab8-0845448e3916 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:28.906411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.908085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:28.919704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:28.920790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:28.921727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:28.924136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 342/676] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:28.925198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.939028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:28.939698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:28.940050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:28.940414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:28.941127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:28.941505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:28.942994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:28.955683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 335/677] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:28.956654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:28.986983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.053472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa0081-2894-4717-b5ba-d0c609701144 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.059959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77aaf-9224-485c-92d0-2301abdc2a3b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.099784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.100088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.100589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.100707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.100938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.101040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.101235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.101329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.102294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:29.102709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.104759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.109985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.111738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.123247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 336/678] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:29.124187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:29.131045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:29.131992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 343/679] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:29.133390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.184655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.214167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.237731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eabf2e-ae6f-45eb-9bd3-99da1736fdef None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.274854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.276206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.276506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.276856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.279032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7499a-ff58-4f0e-86ad-2839c151c853 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.283887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.285410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:29.297643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:29.298804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:29.300000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:29.305313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 337/680] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:29.306141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.323178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2c6d-9a93-436c-8721-5abd7244dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.324293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2c6d-9a93-436c-8721-5abd7244dadf None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.324749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2c6d-9a93-436c-8721-5abd7244dadf None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.325169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2c6d-9a93-436c-8721-5abd7244dadf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.411808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9de62-ef49-4195-bec6-8e819edd1e61 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.418433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2c6d-9a93-436c-8721-5abd7244dadf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.419932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2c6d-9a93-436c-8721-5abd7244dadf None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.447941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.448536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.448813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.449081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.449761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:29.450062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.451593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.455684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.459074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.469415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 338/681] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:29.470257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.528517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 344/682] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:29.534228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dca97-28f1-4e39-8f37-1e3bc7dee92a None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.534518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dca97-28f1-4e39-8f37-1e3bc7dee92a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.534813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dca97-28f1-4e39-8f37-1e3bc7dee92a None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.538734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 345/683] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:29.539481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dca97-28f1-4e39-8f37-1e3bc7dee92a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.577508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653b299-1ec1-4bc1-aa42-15dd2db750ed None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.612896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.613499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.613773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.614044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.614752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:29.615054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.616459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.632915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 339/684] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:29.632915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.651141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dca97-28f1-4e39-8f37-1e3bc7dee92a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.691441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.692002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.692933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.693510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.693785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.694882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=209260a51d244372a392acf3176e8303) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:29.695192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.698068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e4915-95d2-4d3d-bc96-1679c9275260 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.699834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.718821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 346/685] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/role_assignments?user.id=209260a51d244372a392acf3176e8303&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:29.720293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.720585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.720915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.743331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:29.744593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:29.751081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1616d-e654-472f-8113-48feb7625261 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.790227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:29.791015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:29.791966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:29.792314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:29.805456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:29.807263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:29.823843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:29.824862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:29.825732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:29.825732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:29.825732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:29.830007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 340/686] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:29.830997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.838871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 347/687] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:29.838871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:29.981909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919a0a1-98c6-42f4-afe5-960851e0c845 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:29.996997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:29.998727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878c06-6123-4c0c-bc7e-328cf19b12f4 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.028236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.028848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.029134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.029413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.030145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=76127525ce2e45a3b53487d0f92014ff) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:30.030476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.032229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808d61-3eee-4d2a-bf09-d563106ecdba None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.034233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:30.039428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 341/688] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/role_assignments?user.id=76127525ce2e45a3b53487d0f92014ff&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:30.049169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2c46-3793-4022-9b27-2c496d4ad28d None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.049169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2c46-3793-4022-9b27-2c496d4ad28d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.049169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2c46-3793-4022-9b27-2c496d4ad28d None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.049169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 342/689] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:30.051439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.051731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.052075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.053828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.054758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.055244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.055736 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.056631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:30.057641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.059325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.084418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:30.085472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:30.109398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:30.115166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.200140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 343/691] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:30.201035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.248005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16f6c-b346-40bd-bb60-6a4c5278f07d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.293170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.294689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.295457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.295929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.304814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.306975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:30.321236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:30.322168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:30.323145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:30.324191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 349/692] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:30.329997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.338646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174e15-02e4-4414-bdc0-7d31dc159985 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.341769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:30.389612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.390650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.391128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.391666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.402348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:30.405544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.407273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:30.424233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:30.425325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:30.426478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:30.426478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:30.426478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:30.428649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 344/693] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:30.435042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.462382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7f6b7-22a2-45c8-9a87-65ca7467d80f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.500368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.501019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.501307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.501587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.502288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:30.502600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.504229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.517612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 350/694] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:30.518559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.547734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de533e7-fca5-42eb-a38d-b392482cbb4d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.589984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.590641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.590822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.591127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.591779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:30.592077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.593439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.606711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 345/695] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:30.611984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.631776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:30.651373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e925f-0c68-4f95-81d0-3bbaca2d3924 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.670728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:30.712549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.713712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.714001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.714276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.725241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:30.729963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:30.730910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:30.731758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 351/696] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:30.732442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.736053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dec9a-906a-4d0b-8e12-b75166d0393d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.781864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.782746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.783218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.783892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.785079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=64379c68ad5d4aa989691e3dcbdb1900) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:30.785535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.787168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.796385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 346/697] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/role_assignments?user.id=64379c68ad5d4aa989691e3dcbdb1900&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:30.797769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:30.897749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca698e90-40de-4ec2-b204-321162043686 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:30.966295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:30.968823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:30.969441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:30.969723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:30.970001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:30.970677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:30.972846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:30.998406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9218-6b10-487d-9523-eb809a9f1403 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:31.004581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 352/698] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:37:30 2022] POST /identity/v3/users => generated 254 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:31.042830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:31.043475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.043816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.044100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.044830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:31.045147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:31.046721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:31.057692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 347/699] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:31.063140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:31.093503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:31.187034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0515a-c1f9-4384-a08a-bc8894555757 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:31.222331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:31.222970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.223249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.223518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.234770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:31.236230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:31.251555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:31.252527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:31.253407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:31.253407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:31.253407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:31.253407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 353/700] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:31.258363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:31.365789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18614f94-3811-4a8e-9090-33c1fab7a2b3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:31.405904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:31.406518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.406818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.407090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.407732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:31.408033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:31.409386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:31.422731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 348/701] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:31.428528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:31.515489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:31.549669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13327294-f4f5-4dcb-aefc-c8fe8bee3cc7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:31.598133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:31.598807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.599088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.599361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.609111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:31.610554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:31.624752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:31.625913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:31.627173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:31.630379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 354/702] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:37:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:31.644031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:31.651055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:31.788149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e77b-606d-4f76-ae97-bf06253fc593 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:31.834347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:31.835277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.835738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.836193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.837121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:31.837662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:31.839817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698225-f238-49e0-bb57-176971ed9daa None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:31.869897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 349/703] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:37:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:31.883713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:31.931448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f870-8166-480f-92df-f9cb22b40abc None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.931863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f870-8166-480f-92df-f9cb22b40abc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.932212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145f870-8166-480f-92df-f9cb22b40abc None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.938235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 350/704] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:31.938722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:31.939072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:31.939440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:31.965417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:31.966734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:32.025173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1619-45a3-4767-8150-e6e6f806ee49 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:32.035844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 351/705] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:37:32.039161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:32.076231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:32.077196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.077675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.078184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.085962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:32.155411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:32.157232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:32.261068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 355/706] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:32.266361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:32.317893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:32.383965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:32.412754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2c8d-7dd1-48c3-b4f1-f7b6ab5b090e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:32.482320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:32.483542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.484436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.484918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.498866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:32.500821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:32.501224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c6ee-4f6b-4641-8fde-8f26252e650c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:32.528116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:32.529336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:32.530420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:32.530420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:32.530420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:32.532844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 352/707] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:32.538989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:32.565578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:32.566451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.567582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.568148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] PATH_INFO: `/v3/services/network` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.569011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:32.571341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:32.588440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:32.589680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:32.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:32.598552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 356/708] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:32.602401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:32.622129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:32.702361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efba571-6290-4545-9437-bcfa40b01920 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:32.740875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:32.741719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.742167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.742581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.743431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:32.743887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:32.745834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157128e-bf12-47a1-a70a-1eb1c25ebcdf None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:32.755742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:32.761528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8af51-771d-43ee-96cf-c197807a5d95 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:32.767435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 353/709] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:32.769874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65047f3-8056-4562-bf02-9b98777d07a1 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.770416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65047f3-8056-4562-bf02-9b98777d07a1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.770918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65047f3-8056-4562-bf02-9b98777d07a1 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.773191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 354/710] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:32.774843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65047f3-8056-4562-bf02-9b98777d07a1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:32.798419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:32.799100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.799380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.799652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.800281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] RBAC: Adding query filter params (name=network) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:32.800584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:32.802214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582135-862b-4d18-b912-3666d0b814d6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:32.807913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 357/711] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:32.809065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.809348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.809621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.833949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:32.834929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:32.904380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65047f3-8056-4562-bf02-9b98777d07a1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:32.906252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:32.926102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 358/712] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:32.927779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:32.943239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:32.943969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:32.944256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:32.944530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:32.952367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:32.953916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:32.966128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:32.967106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:32.968630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 355/713] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:32.975519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:33.050721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:33.059261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3393-fc2c-4b25-bfbd-9b84cbf4ae8c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:33.095485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:33.096452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.096890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.097460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.098265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] RBAC: Adding query filter params (type=network) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:33.098748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:33.100447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:33.108103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 359/714] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:33.194596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423631-20b7-4b44-afa1-dc886e68c73a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:33.253038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:33.258373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:33.258572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.259024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.259024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.259720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:33.260074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:33.261549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:33.275199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 356/715] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:33.281608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:33.308862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:33.371215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00a99-9c04-4272-8650-e983caf30475 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:33.409631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:33.410264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.410541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.410845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.411427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:33.412816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-335af7e0-9871-40e5-bdcd-6c6f286c026a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:33.423212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:33.424273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:33.425201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:33.426237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f48e5-f087-4e61-887e-b257d366305c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:33.429331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 360/716] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 12 11:37:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:33.430593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a147e7-2ff8-454c-9802-761fc0f37f68 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.430914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a147e7-2ff8-454c-9802-761fc0f37f68 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.431191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a147e7-2ff8-454c-9802-761fc0f37f68 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.433333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 361/717] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:33.434554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a147e7-2ff8-454c-9802-761fc0f37f68 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:33.461113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:33.468451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:33.469869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.470339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.470846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.472011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=1b3bee55e837447180812b0f2bb2abd7) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:33.472519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:33.475279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460213-9fe6-4040-86ee-9c4fb3bbf938 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:33.484347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 357/718] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:33 2022] GET /identity/v3/role_assignments?user.id=1b3bee55e837447180812b0f2bb2abd7&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:33.490646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8f984-de19-4809-a599-ac026cc71705 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.490646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8f984-de19-4809-a599-ac026cc71705 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.490646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8f984-de19-4809-a599-ac026cc71705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.531780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-98b8f984-de19-4809-a599-ac026cc71705 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:33.532993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-98b8f984-de19-4809-a599-ac026cc71705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:33.616833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a147e7-2ff8-454c-9802-761fc0f37f68 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:33.628340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 358/719] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:33.652733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156709da-65b9-4f1a-a015-007bbff75120 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.653069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156709da-65b9-4f1a-a015-007bbff75120 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.653283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156709da-65b9-4f1a-a015-007bbff75120 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.658578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 359/720] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:33.660065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.660372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.660628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.677676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:33.678743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.679247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.679354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:33.679839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.680595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:33.680878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:33.681387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:33.683148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:33.691827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:33.695028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 362/721] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 12 11:37:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:33.702525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:33.794109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:33.801873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 360/722] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:37:33.811034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a3da4-be84-4bc1-9119-6064e623e421 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:33.846433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:33.847090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:33.847370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:33.847645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:33.848277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:33.848579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:33.849948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:33.855445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 363/723] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 12 11:37:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:33.944591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.082965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4eb43-4b04-47fd-9ef4-ad77fc9f14a3 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.092636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.118933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.119611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.119889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.120157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.130964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:34.135921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:34.136855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:34.137707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 361/724] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:34.143437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.160888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:34.260292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9128-13d6-4221-b777-db834e1ae630 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.302899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.303507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.303785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.304053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.304716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:34.305017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:34.306370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:34.326364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 362/725] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:34.329771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c177a59-56ac-480d-a250-a68a4d493299 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.332076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.393948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.394578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.394886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.396786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.420493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:34.430745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:34.431708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:34.432563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 364/726] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:34.438621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.441692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:34.463057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:34.503019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232025-a536-433d-90da-dcdf4285ba2e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.574938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.575574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.575852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.576123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.599623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:34.601375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:34.609299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9be741-cb30-4b3f-b16c-d6d75eeda7c1 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:34.623725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:34.624683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:34.625573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:34.625573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:34.625573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:34.625573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 363/727] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:34.631088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.646883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.647741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.648222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.648666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.649504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:34.649981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:34.652178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:34.666700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 365/728] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:34.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.788208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:34.798515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca12be5-1a67-4d2d-81e6-d7667feaf1d9 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.827611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:34.835679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5645e-e773-4d23-b4af-5f4e44f69cf0 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:34.845611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.846468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.846945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.847395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.848209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:34.848864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:34.850405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:34.867018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 364/729] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:34.883219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:34.891963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:34.892607 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:34.892884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:34.893153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:34.906874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:34.908876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:34.926108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:34.927101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:34.928015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:34.928015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:34.928015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:34.932944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 366/730] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:34.935744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.040395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d29435-2638-4c25-b2dd-123df9633e76 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:35.084746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:35.086758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.087042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.087310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.105254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:35.106792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:35.119443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:35.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:35.121351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 365/731] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:35.127961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.163828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6bd6d-017f-4f44-9768-d761642f3747 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:35.204055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:35.209822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:35.233629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:35.234687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.235190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.235683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.236567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:35.237128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:35.238799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:35.252564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 367/732] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:35.258516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.335514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5390-6923-4ccc-91e0-0fc2834dd0b9 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:35.392125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:35.392739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.393017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.393289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.394042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:35.394309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:35.395773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdd3d0-7cbd-4a28-aa08-99f00d281d67 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:35.414496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 366/733] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 12 11:37:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:35.419230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddef76-f064-4f68-a170-0aa70ccf9809 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.419230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddef76-f064-4f68-a170-0aa70ccf9809 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.419230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddef76-f064-4f68-a170-0aa70ccf9809 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.421219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e605f-6ffd-48ab-9afd-85374a1f3b26 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:35.421454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 367/734] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:35.422214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddef76-f064-4f68-a170-0aa70ccf9809 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.457717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:35.458731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.459278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.459785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.468077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:35.469855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-101692ea-5ee3-43a1-a056-45e1fc469bc2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:35.482486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:35.483467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:35.484407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:35.487056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 368/735] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:37:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:35.488444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.488927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.489399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.509354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:35.511483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:35.530078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:35.535662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddef76-f064-4f68-a170-0aa70ccf9809 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:35.558062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:35.577998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:35.578804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.579086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.579396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.589404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 369/736] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:35.590489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.696223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:35.697707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:35.750714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1401-6df2-476a-bc24-a36817df5f21 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:35.814289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:35.814938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:35.815219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:35.815492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:35.816232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:35.816536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:35.817986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:35.852361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 370/737] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 12 11:37:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:35.865067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.868696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:35.893217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 368/738] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:35.902036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:35.914976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:35.987517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552409ad-39ab-453b-974e-715cfa10b4da None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.021725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f9fdc-8940-43f7-840d-83b7636a0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.022330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9fdc-8940-43f7-840d-83b7636a0b00 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.022616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9fdc-8940-43f7-840d-83b7636a0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.022915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9fdc-8940-43f7-840d-83b7636a0b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.046983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28907-a34d-47aa-88f1-913beacafadd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.085531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.086266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.086834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.086958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.092837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f9fdc-8940-43f7-840d-83b7636a0b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.094287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f9fdc-8940-43f7-840d-83b7636a0b00 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.098109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.099633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:36.114799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:36.115906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:36.117150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:36.117150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:36.117150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:36.117150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 369/739] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:36.117150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.127158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:36.167711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:36.199485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 371/740] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:37:36.200850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467ab4-87f8-48de-bd63-9c84865805ea None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.201259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467ab4-87f8-48de-bd63-9c84865805ea None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.201542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467ab4-87f8-48de-bd63-9c84865805ea None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.202885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 372/741] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:36.204042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153970-911c-47e7-8caf-caa1d6fe6cab None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.204146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153970-911c-47e7-8caf-caa1d6fe6cab None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.204437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153970-911c-47e7-8caf-caa1d6fe6cab None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.205573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 373/742] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:36.206256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61153970-911c-47e7-8caf-caa1d6fe6cab None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.225736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382123a-0797-4faf-bb25-9f6be94410b7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.259475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.260108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.260389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.260661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.261322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.262705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.278704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 370/743] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:37:36 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:36.279493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.321929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61153970-911c-47e7-8caf-caa1d6fe6cab None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.351137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:36.360359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.360967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.361245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.361505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.362163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:36.362463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.363905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c8bf-7d44-4ba2-b538-f9e202d1dccd None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.380494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 374/744] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:36.380494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.380494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.380494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.397484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:36.398662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:36.400148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07ded4-c1cb-4f3d-8799-f5e12de7ecdc None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.411868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:36.444512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.445354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.445483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.447093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.457451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.459085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fbb62a3d-8b02-4dab-afc0-885a46c083f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:36.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:36.476791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:36.478125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:36.478125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:36.478125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:36.478125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 371/745] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:36.479259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.479554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.479829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.499399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:36.500622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:36.576421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 372/746] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:36 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:36.577607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.615147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 375/747] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:36 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:37:36.616226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.746020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:36.763290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37d557-ac43-426f-a585-61a06a071e08 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.809401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df5a8e-87ec-45b4-9dd3-1e1206ddbbbf None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.838953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:36.843292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.843937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.844217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.844490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.851765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.853364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.861047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:36.861953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:36.862434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:36.862931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:36.863785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:36.864303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:36.865899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:36.875248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:36.876390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:36.877279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:36.879652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 373/748] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:36.885720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 376/749] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:36.886829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.888006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:36.990745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53890-eaa8-4dc6-a71b-537e6387882d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:36.999799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39308984-c83c-40c8-90e1-21c1c5cdb229 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.027768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.028384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.028765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.028933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.034498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.035127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.035407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.035806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.036388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:37.036932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.038100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.039678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:37.044318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:37.045229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:37.046088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:37.050361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 377/750] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:37.051461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.052661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 374/751] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:37.053317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.068996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:37.094553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:37.157292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f42a-c0d0-4bba-ae38-6543c98c365d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.163604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e6f9-eb89-417a-837c-7e7308d6c9fc None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.191532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.192153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.192430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.192703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.199244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.199580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.200361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.200672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.201413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.201840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.202651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.204161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:37.212410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:37.214013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:37.215213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:37.218919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 378/752] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:37.219730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.231064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 375/753] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:37:37 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:37.232180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.334320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:37.339929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a0a2-b9cb-46cc-85a1-51350af0d74a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.347134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:37.398355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.398355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.398355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.398355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.399100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:37.399407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.401362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.407515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1bcd7-f88a-4c75-a7e2-a5fbfb198cc4 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.415971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 379/754] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:37.421339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.454067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.455017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.455711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.455998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.457010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=64379c68ad5d4aa989691e3dcbdb1900) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:37.457324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.459055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.467487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 376/755] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/role_assignments?user.id=64379c68ad5d4aa989691e3dcbdb1900&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:37.468403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.534367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65aaf3-24ce-4229-bb16-e55aaae0a103 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.574080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.574866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.575249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.575587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.576356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:37.576725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.578246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.591107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 380/756] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:37.599588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.608943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9291b1b-1e99-4961-8788-d78cd5567106 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.622433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:37.640807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:37.645902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.646983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.647582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.648149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.659621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.661221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:37.677442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:37.678705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:37.679818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:37.679818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:37.679818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:37.681175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 377/757] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:37.690509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:37.721768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8577-af1d-4062-9628-2ab323e1f340 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.769304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.770212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.770492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.770793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.771803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=67819b0ba6554d5980f1c6458f3e98f8) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:37.772106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.773737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.781490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 381/758] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/role_assignments?user.id=67819b0ba6554d5980f1c6458f3e98f8&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:37.895094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f371b1-064e-4a7e-a81a-3df5fa47d3ee None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:37.951195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:37.952086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:37.952535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:37.952951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:37.953785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:37.954238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:37.955896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:37.978548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 378/759] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:37.985221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:38.071015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:38.096248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fcf33-3241-4e59-a182-9058e8dab2be None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:38.138694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:38.139267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:38.139543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:38.139821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:38.148208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:38.149694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:38.167003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:38.168933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:38.169913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 382/760] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:37:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:38.176987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:38.245287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:38.314375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737e011-a297-4ee6-bd72-dc1699c5aab8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:38.354183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:38.355004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:38.355299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:38.355574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:38.356304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:38.356613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:38.358025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c439d-0ed0-44b7-ab5a-dd91674255ee None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:38.375743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 379/761] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:37:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:38.381201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:38.440008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3f859-6b68-4a02-8e5d-fddc9ec6a82e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:38.440194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3f859-6b68-4a02-8e5d-fddc9ec6a82e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:38.440477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3f859-6b68-4a02-8e5d-fddc9ec6a82e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:38.441805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 380/762] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:38.455985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:38.456273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:38.456647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:38.476910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:38.478249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:38.513124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7c0ee-22ed-47a7-bc5b-28aef352de1e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:38.551479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 381/763] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:38.591852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:38.592709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:38.593140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:38.593579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:38.606357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:38.608765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:38.610357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:38.634423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:38.636210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:38.637359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:38.637359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:38.637359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:38.639358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 383/764] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:38.644776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:38.698284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:38.789609 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59a9c4-2edf-4dd6-b923-882eeb9fbd0c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:38.836251 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:38.836856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:38.837137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:38.837406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:38.838558 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:38.838885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:38.840229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:38.851732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 382/765] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:38.857689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:38.905270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.003099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30972bf-f707-416d-ad4e-2cecea60fce6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.007172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:39.023401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f9e2-01ce-40bc-92ef-0285466bf30c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.038505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.039168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.039451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.039728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.047207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.048649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:39.060694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:39.061575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:39.062565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 384/766] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:39.067544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.095918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.096913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.097395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.097889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] PATH_INFO: `/v3/services/network` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.098712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.100274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.124283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:39.125427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:39.126389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:39.127254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:39.131866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 383/767] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:38 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:39.137725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.177027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abbd6-cb5a-4efa-b01d-d69e17f0c5d9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.213698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.214311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.214595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.214894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.215590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:39.215898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.225778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.230956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 385/768] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:39.236895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.293360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467941f-20bc-4202-939a-5f7bc2bb1f8d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.334641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.334641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.334641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.334641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.335058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] RBAC: Adding query filter params (name=network) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:39.335058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.335058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.344077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 384/769] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:37:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:39.348347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.384301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:39.452989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6b81c-754a-4479-85a8-a6b58ed492f8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.479842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:39.526435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a6f5-7a30-498e-bd21-2af40addeb0a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.535941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.536606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.536879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.537148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/1b3bee55e837447180812b0f2bb2abd7/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.542391 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=1b3bee55e837447180812b0f2bb2abd7, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.543900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.568702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 386/770] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:39 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/1b3bee55e837447180812b0f2bb2abd7/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:37:39.585372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.586060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.586393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.586696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.587400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] RBAC: Adding query filter params (type=network) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:39.587703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.589218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.600878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 385/771] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:37:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:39.602400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.716150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53f360-4b0b-45c4-8285-b996f0a37f08 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.754010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.754778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.755057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.755327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.756086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] RBAC: Adding query filter params (interface=public, service_id=b4ddce4f75c54c0a9e1ec122af438dfd, region_id=RegionOne) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:39.756393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.757772 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76044d93-442c-400f-8f36-e3122e0b2064 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.770757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 387/772] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:37:39 2022] GET /identity/v3/endpoints?service_id=b4ddce4f75c54c0a9e1ec122af438dfd&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:39.772690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:39.791223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24313f38-f65b-4901-95aa-c457121a3eaa None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.791534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24313f38-f65b-4901-95aa-c457121a3eaa None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.791774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24313f38-f65b-4901-95aa-c457121a3eaa None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.793250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 388/773] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:39.799506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cbcfa-5e42-47b4-96b7-7ef263f4d729 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.800100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cbcfa-5e42-47b4-96b7-7ef263f4d729 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.800577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cbcfa-5e42-47b4-96b7-7ef263f4d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.821391 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-336cbcfa-5e42-47b4-96b7-7ef263f4d729 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:39.823515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-336cbcfa-5e42-47b4-96b7-7ef263f4d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:39.861341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:39.902327 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:39.916223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 389/774] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:37:39.922636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8b0a-506b-4cc2-8094-f6288b0efbca None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.922801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5a2e-6d2c-4cf4-80a9-4db06e3e4603 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:39.923774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8b0a-506b-4cc2-8094-f6288b0efbca None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.924204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8b0a-506b-4cc2-8094-f6288b0efbca None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.926232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 390/775] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:39.932175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d2cc-e826-4059-9db9-0457416b98a8 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.932637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d2cc-e826-4059-9db9-0457416b98a8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.933059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d2cc-e826-4059-9db9-0457416b98a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.965662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e1f4d2cc-e826-4059-9db9-0457416b98a8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:39.968875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e1f4d2cc-e826-4059-9db9-0457416b98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:39.972595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b301-f00a-41ea-a96c-9d096158083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:39.973210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b301-f00a-41ea-a96c-9d096158083a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:39.973498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b301-f00a-41ea-a96c-9d096158083a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:39.973775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b301-f00a-41ea-a96c-9d096158083a None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:39.974386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7b301-f00a-41ea-a96c-9d096158083a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:39.976002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7b301-f00a-41ea-a96c-9d096158083a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:39.989547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 386/776] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:37:39 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:40.056653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 391/777] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:37:40.245055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4225e-ab51-4030-8f81-173bb5dc6bdd None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.245424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4225e-ab51-4030-8f81-173bb5dc6bdd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.245637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4225e-ab51-4030-8f81-173bb5dc6bdd None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.247169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 387/778] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:40.252535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.252810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.253086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.273001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:40.274161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:40.317500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4225e-ab51-4030-8f81-173bb5dc6bdd None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.354831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 392/779] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:40.370212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.400196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:40.435719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4225e-ab51-4030-8f81-173bb5dc6bdd None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:40.472997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:40.474034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.474456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.474872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.480156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6473-169e-465a-9948-b626c199a7c1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:40.488410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:40.494747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:40.495724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:40.496556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:40.497191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 388/780] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:40.503577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.519011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:40.549894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:40.550645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.551148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.551416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.551996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:40.553357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:40.575219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:40.576228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:40.577063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:40.579041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 393/781] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:40.583407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.692928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e42bf-0c8a-420b-b25f-ff286cf82945 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:40.710552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:40.721689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8f06-e3a0-4ad3-8bdf-dd40819433ab None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:40.734348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:40.735007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.735289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.735565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.736236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:40.736539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:40.738219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:40.747525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 389/782] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:40.748748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.760501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:40.761490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.761944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.762486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.763322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:40.763811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:40.765445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:40.770845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 394/783] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:40.771918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.829599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:40.865203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a66f2a-653d-4502-8a6d-3caf40dc22c1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:40.896824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf3607-7272-45cd-91ae-933636a80a21 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:40.901591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:40.902396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.902880 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.903314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.914021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:40.919451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:40.920440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:40.921267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 390/784] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:40.921956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.937131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:40.937777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:40.938052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:40.938326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:40.953672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:40.955216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:40.974532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:40.975603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:40.976894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:40.976894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:40.976894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:40.976894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 395/785] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:40.977358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:40.988001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98be9-e835-4f77-8f59-2862e7719813 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.084365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59598b32-c28b-4c24-9fbf-aeb3e8314159 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.116717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.120099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.120867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.121077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.121352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.122018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:41.122323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.123727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.125568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.126393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.126927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.127389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.128185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:41.128659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.130170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.132734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 396/786] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.133551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.136333 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 391/787] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 12 11:37:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.137780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.205456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.239827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b978f9-df4c-450e-8aa9-0ce47b5482d6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.242284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00ca7-3518-4fb8-9b5c-7bf4ded47216 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.275166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.276338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.276610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.276875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.279866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.280705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.281182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.281671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.282522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:41.283073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.284627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.288278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.289695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.302881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 397/788] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.304030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:41.306446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:41.307984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:41.308995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:41.308995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:41.308995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:41.309622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 392/789] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:41.310264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.370199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.427914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9457b0-794f-44cd-85ac-d433971e4124 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.429355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c2bc9-4788-444a-aaa3-881450312ccc None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.462597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.466580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.467505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.468021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.468495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] PATH_INFO: `/v3/users/swift` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.473227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.473834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.474110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.474380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.475112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] RBAC: Adding query filter params (interface=public, service_id=81a18e14acd34262af94996942798560, region_id=RegionOne) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:41.475414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.476775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.478569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.480218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.482852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 398/790] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/endpoints?service_id=81a18e14acd34262af94996942798560&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.484113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:41.493542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:41.494627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:41.495590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:41.497801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 393/791] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:41.498802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.606429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca3f8-0623-47ff-9db8-ef127d57e24f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.608824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326bd5a-bb0f-4fd9-a54d-7279abee0dfa None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.614135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.644688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.645738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.646238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.646782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.647774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.649556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.649983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.650633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.650907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.651175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.651971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:41.652274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.654020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.657212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 394/792] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.658275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.671418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 399/793] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.679714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.748739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.773436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e6460-f575-4177-90f1-6dfb7da563d8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.801770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b72e-226d-4992-a3c7-45e4eba2de9b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.812110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.812942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.813371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.813791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.814720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:41.815175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.816797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3b32-ab11-4371-9150-716211253d59 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.836579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 395/794] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:41.838670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8516c-0a54-43b6-9cc6-efb21ce0f36c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.839131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8516c-0a54-43b6-9cc6-efb21ce0f36c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.839569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8516c-0a54-43b6-9cc6-efb21ce0f36c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.841328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 396/795] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:41.842208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8516c-0a54-43b6-9cc6-efb21ce0f36c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:41.852651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:41.853243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.854159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.854436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.863112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:41.864594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b090f60d-468b-4a2c-8305-5fbcf2ead43d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:41.877312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:41.878456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:41.879658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:41.882715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:41.885430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 400/796] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:41.886856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:41.887148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:41.887426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:41.906554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:41.907716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:41.973042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8516c-0a54-43b6-9cc6-efb21ce0f36c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:41.989834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 401/797] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:41.990731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.036289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.039025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.040767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.041321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.068247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.070158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.082458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:42.097993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:42.099364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:42.100268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:42.100268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:42.100268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:42.109218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 397/798] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:42.113658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.195567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f99ef6-a3f1-4d40-9302-5ac6b95a390b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.263385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.264001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.264277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.264547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.265279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:42.265581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.267818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.271033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:42.304691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 402/799] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 12 11:37:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:42.307149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ea72e-3afa-4cf8-8c8c-393982256b28 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.311271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.345004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.345614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.346078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.346310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.346995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:42.347647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.348833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.361672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 398/800] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:42.362491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.419104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:42.422487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17593-88b9-4b03-a6c5-1e7429a65170 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.460390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.460934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.461212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.461489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.472710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.474139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.475190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c36f-0831-4178-b0fc-7eecf48e84cd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:42.488855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:42.490220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:42.491115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:42.491115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:42.491115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:42.491115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 403/801] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:42.491115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.516276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e389e3-19d2-4b72-85f7-166355d0a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.516911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e389e3-19d2-4b72-85f7-166355d0a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.517193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e389e3-19d2-4b72-85f7-166355d0a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.517468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e389e3-19d2-4b72-85f7-166355d0a8d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.524942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:42.528958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e389e3-19d2-4b72-85f7-166355d0a8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-b5e389e3-19d2-4b72-85f7-166355d0a8d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:42.533800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:42.534820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:42.535676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:42.539706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 399/802] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:42.541775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36695-aa52-4155-af01-03a0c91b7cbe None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.542066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36695-aa52-4155-af01-03a0c91b7cbe None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.542343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36695-aa52-4155-af01-03a0c91b7cbe None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.544136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 400/803] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:42.544829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e36695-aa52-4155-af01-03a0c91b7cbe None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.606357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec18c25-20a9-43a8-9a17-490fa985713a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.645947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.646716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.646999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.647279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.652156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e36695-aa52-4155-af01-03a0c91b7cbe None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.653945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.655535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:42.667071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:42.667959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:42.668894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:42.672924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 404/804] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:42.673553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.691069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.691676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.692061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.692237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.692538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:42.692882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:42.693189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.694731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fda5d-a62b-411e-915a-e87a8dc89b20 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.706394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 401/805] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:42.707659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.707954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.708261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.725879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:42.727051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:42.786519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:42.799928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 402/806] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:42.800184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0ec5-38a8-4c9f-b986-89e02cd525ad None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.801484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.856030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.857015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.857544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.858020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.858930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:42.859436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.861077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.877949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 405/807] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:42.879331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.920781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392458-98f9-41d3-948b-8d4cd08d0b05 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:42.956250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:42.957020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:42.957403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:42.957758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:42.958538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:42.958941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:42.960525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:42.975102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 403/808] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:42.976104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:42.978170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.013182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60161ace-9ae2-43d7-932d-04c9acfc3e00 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.031818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.053692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.054590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.055101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.055574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.063247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.064988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:43.076852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:43.077711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:43.079117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:43.081138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 406/809] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:43.082076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.105849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c538401-d121-4e8d-96c2-c325b28c596f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.145514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.146151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.146437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.146761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.158136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.159603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:43.176971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:43.177996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:43.178966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:43.178966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:43.178966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:43.178966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 404/810] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:43.179190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.200408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae14c4-7192-4dcb-a24f-503494e31db5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.239549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.240474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.240758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.241035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/64379c68ad5d4aa989691e3dcbdb1900/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.242990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=64379c68ad5d4aa989691e3dcbdb1900, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.244465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.246718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.270273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 407/811] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:43 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/64379c68ad5d4aa989691e3dcbdb1900/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:43.270273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.302977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282b605-803a-467e-a2fb-ffd7d0c6dfa6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.305047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.352940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.354246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.354960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.355248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.355970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:43.356284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.358207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.376730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 405/812] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:43.377890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.403312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a2ef-0f15-45d9-b7f7-46c8b5914462 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.445036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.445948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.446246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.446522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] PATH_INFO: `/v3/services/network` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.447667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.449475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:43.458701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:43.459877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:43.460728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 408/813] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:43.461538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.505046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af583b07-cd0c-4190-929d-dfe7b788e3af None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.524809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.546484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.547129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.547414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.547795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.548460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:43.548766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.550144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.564539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 406/814] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:43.565493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.587192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c45d2-77e3-4a22-8414-3635193aecce None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.597250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.634096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.634864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.635142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.635413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/67819b0ba6554d5980f1c6458f3e98f8/roles/79a1959b832e471fa2b0385028524292` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.654770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=67819b0ba6554d5980f1c6458f3e98f8, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.657624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.674393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 409/815] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:43 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/67819b0ba6554d5980f1c6458f3e98f8/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:43.683924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.695924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85086b8-369d-4877-b8cd-d9142c546bd8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.739413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.740408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.740909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.741446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.743282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] RBAC: Adding query filter params (name=network) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:43.743838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.746633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a87b35-bf62-401c-83ee-b87c62af107e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.758731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 407/816] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:43.758731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48eb8-12dc-42c5-94bc-2b37834b0f8a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.758731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48eb8-12dc-42c5-94bc-2b37834b0f8a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.758731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48eb8-12dc-42c5-94bc-2b37834b0f8a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.759615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 408/817] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:43.763668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e48eb8-12dc-42c5-94bc-2b37834b0f8a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:43.821185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d634f-3a95-41a7-bbd5-c369ca8a6662 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.834990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.877615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.877615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.877615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.877615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.881061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:43.889939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.890800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-6fb26ac0-1c8a-4c6c-9df9-74915132f91d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:43.903617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:43.904610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:43.905942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 410/818] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:43.906621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.906621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.906751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.915497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e48eb8-12dc-42c5-94bc-2b37834b0f8a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:43.931128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:43.932707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:43.961308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:43.961941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:43.962226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:43.962500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:43.963970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] RBAC: Adding query filter params (type=network) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:43.964279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:43.966375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:43.973579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 409/819] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:43.974409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.016736 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 411/820] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:44.017934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.128836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:44.133529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586945b-7229-4d0a-87c0-a2a5ba61b907 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.175089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.176406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.177240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.177709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.178561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.180176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.196833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133306-6e23-4204-a80f-ac018aef2536 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.209211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 412/821] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:37:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:44.263210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.263899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.264242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.264569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.265400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:44.265760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.267373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.288681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:37:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:44.294572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.414425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.419671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:44.439152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789af9-a25e-4424-8061-9307edaec236 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.485089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.485971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.486447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.486899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.513329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:44.542175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fa760-3ffa-4fc9-af7c-8cf617f2ff34 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.561328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.563406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.580159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.580864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.581205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.581544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.582228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.583919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:44.593952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:44.594976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:37:44.595820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:44.600014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 411/823] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 12 11:37:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:44.601101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.671102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 413/824] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:37:44.677231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:44.679546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.714983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e772b3-0c78-48f3-9f94-48f9de2d5207 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.739319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:44.759759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.760397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.760687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.760965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.761828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:44.762243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.764392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.774499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 412/825] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 12 11:37:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:44.777607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.812619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea32fe-e894-4f40-94c3-4980f3338e0d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.850322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.851101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.851375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.851649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.863123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.864798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:44.887102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:44.888096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:44.889751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:44.889751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:44.889751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:44.892980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 414/826] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:44.898903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:44.914632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecd06c-28d2-4d43-b8de-e674aa6f32a7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:44.941126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:44.947573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:44.948216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:44.948867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:44.949229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:44.949967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:44.950350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:44.951892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:44.958653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 413/827] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 12 11:37:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:44.966368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:45.013023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcbd33-ec72-4005-b06a-062f7ad26d16 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:45.020011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:45.049307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:45.049887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.050163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.050434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.051372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:45.051671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:45.053088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:45.069654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 415/828] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:45.070864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:45.075827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec3db9-5490-4186-815f-f8fb19207afe None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:45.111739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:45.112752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.113226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.113807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.114675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:45.116306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:45.151882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 414/829] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:37:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:37:45.192168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f259665-18ba-4c9b-a403-669a04a238e1 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:45.240092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:45.241103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.241580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.242115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.250238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:45.252158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-fcc4fd51-58bf-4f03-a9d7-4d6f4727d7c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:45.265814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:45.266872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:45.267767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:45.270263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 416/830] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:45.276537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:45.337122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:45.386273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c85a73-fc0d-44bd-bc05-a78073c827bb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:45.392267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a831c6-5c1e-4cd5-8bdb-5ef51bcbcba2 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.392550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a831c6-5c1e-4cd5-8bdb-5ef51bcbcba2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.392831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a831c6-5c1e-4cd5-8bdb-5ef51bcbcba2 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.394420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 417/831] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:45.399343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.399628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.399900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.421916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:45.423149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:45.426538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:45.427504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.427961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.428403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.429267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:45.429742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:45.431991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:45.442719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:45.446887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 415/832] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:45.458655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:45.514703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 418/833] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:45.576345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45072d-0726-4524-abfb-54d002339423 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:45.590957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:45.614679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:45.615321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.615595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.615916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.616640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=1b3bee55e837447180812b0f2bb2abd7) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:45.616944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:45.618352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fe62f-d73a-40f3-96ec-20495a39c7f3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:45.629187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 416/834] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:45 2022] GET /identity/v3/role_assignments?user.id=1b3bee55e837447180812b0f2bb2abd7&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:45.789903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:45.808959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a99145-2909-4a0e-8263-35db213a0385 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.809247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a99145-2909-4a0e-8263-35db213a0385 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.809523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a99145-2909-4a0e-8263-35db213a0385 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.811010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 417/835] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:45.816779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.817325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.817606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.837866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:45.839124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:45.908610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad5f68-389e-47ad-8090-b4e37704dba3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:45.926958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 418/836] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:37:45.942939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:45.943679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:45.943954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:45.944223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:45.955086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:45.959703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:45.960624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:45.961465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 419/837] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:45.967242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.071977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252565fc-af36-4c47-9fcc-ad0d3d7007ea None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.080521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.108061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.109017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.109484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.109994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.110861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:46.111346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.112878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.121900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 419/838] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:46.127718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.143873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.229537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.247701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc434f5-9a99-4a2d-a2e0-741b75306bd2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.283286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.284280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.284766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.285225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.295848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.297596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:46.314589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:46.315643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:46.316542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:46.316542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:46.316542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:46.318732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 420/839] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:46.328695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.341782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde107-1785-4ff9-b82d-369b40939507 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.381209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.382009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.382289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.382565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.393936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:46.399486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:46.400936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:37:46.401778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:46.406036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 420/840] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:46.406890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.407856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.438986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.452929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1b84d-2b17-4339-8a44-94e5f5abb1c4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.494877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.495582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.495946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.496306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.497290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:46.497598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.499578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.518762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 421/841] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:46.520341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.527455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8f20-7ab2-4ddc-8dc2-ac3ec1dd7921 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.566296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.566945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.567228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.567502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.568169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:46.568473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.569828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.583865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 421/842] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:46.585039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.646999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643be7b1-9bcb-49e9-986e-13ca7244bba4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.677999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.688033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.691788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.692716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.693300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.693722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.704035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d28e81-3660-4b73-9fdd-d9a54417c5ba None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.705281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.707943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:46.723588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:46.724569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:37:46.725515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:46.732947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 422/843] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:46.733733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.746670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.747307 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.747589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.747861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.760293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.761885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:46.781824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:46.782871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:46.783777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:46.783777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:46.783777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:46.788211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 422/844] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:46.789072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.870816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ce31d-ea4e-42c7-b3d0-a8e99141e3a4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.907515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492d48-26d9-49e8-8463-7331e4694fd2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:46.916419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.917289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.917766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.918213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.919151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:46.919640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.921269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.944442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 423/845] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:46.945274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.949681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:46.950777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:46.950777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:46.950971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:46.951587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:46.951889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:46.953249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:46.966489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 423/846] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:46.975371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:46.978136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:46.992670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.051259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08b07-e6a0-4fa0-885b-86eb271278f4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.087027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ac6eb-622b-4516-9069-664b34052d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.087781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ac6eb-622b-4516-9069-664b34052d95 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.088065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ac6eb-622b-4516-9069-664b34052d95 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.088339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ac6eb-622b-4516-9069-664b34052d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.091338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55dd5-d352-46e2-ac82-4bbaba5bd95b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.128654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.129652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.130235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.130791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.139915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.141851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-3b275bf5-170a-4d88-b2bf-b2bd7e872219 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:47.153948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:47.154981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:47.155927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:47.163228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 424/847] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:47.164545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9a666-a059-4b7b-ad23-86183882954a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.164835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9a666-a059-4b7b-ad23-86183882954a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.165110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9a666-a059-4b7b-ad23-86183882954a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.167106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 425/848] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:47.167213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ac6eb-622b-4516-9069-664b34052d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.168580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ac6eb-622b-4516-9069-664b34052d95 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.171725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9a666-a059-4b7b-ad23-86183882954a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.221121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.241708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.283208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 424/849] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:37:47.284894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.285012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9a666-a059-4b7b-ad23-86183882954a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.285420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.285836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.304156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:47.305367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:47.323754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.324479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.324916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.325287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.326250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:47.326771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.328359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.355977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 426/850] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:47.356623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.374308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 425/851] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:47.375568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.468955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.489479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f24b3-b2b2-47d0-a0fe-d8cf1c1f83de None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.509172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739d17-8f86-4c09-8a40-fd0bfcb59089 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.517592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.536499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.537770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.538248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.538742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.553229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.555354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.557265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.558206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.558574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.558944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:47.575277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:47.576244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:47.577128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:47.577128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:47.577128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:47.583309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 427/852] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:47.584271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.649251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.651292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.690009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5754f30-60d9-432c-9c3a-f35b7060cc4d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.718069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.726714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.727257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.727533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.727833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.729029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:47.729331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.730692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87c0dd-8e05-4f1e-a1a7-6d6d201b4a19 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.741995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 428/853] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:47.743142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf77c3-0b70-4ced-95d6-7a4d0cd0bcff None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.743422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf77c3-0b70-4ced-95d6-7a4d0cd0bcff None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.743703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf77c3-0b70-4ced-95d6-7a4d0cd0bcff None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.745084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 429/854] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:47.747308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf77c3-0b70-4ced-95d6-7a4d0cd0bcff None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.754111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 426/855] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:37:47.754111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.783802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.849004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3beed-2b9d-444a-bfba-fed666f01d40 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.853045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf77c3-0b70-4ced-95d6-7a4d0cd0bcff None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:47.886948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.887580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.887859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.888062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:47.888171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.888684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.888963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.889235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.889844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.891222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.894878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:47.896292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-20d07fd5-9dae-4145-8417-e330c911ade2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:47.899547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:47.900589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:47.901441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 430/856] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:47.902243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:47.902243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:47.902243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:47.908453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:47.910538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 427/857] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:47.912266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:47.920729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:47.921907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:47.941641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:47.986816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 431/858] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:47.987555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.018339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.018494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979b8b-a462-4794-afc6-e741ec2e3feb None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.054026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.054709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.055020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.055299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.066285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.067743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:48.082068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:48.083059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:48.083981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:48.083981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:48.083981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:48.083981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 428/859] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:48.083981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.095866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8ec3-0421-4890-96ab-37e607b5bb05 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.132939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.133503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.133780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.134053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.135209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.135514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.136854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.141187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 432/860] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:48.141941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.173897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.189293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add233-50fb-472c-85a3-6b3d8e578dd4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.225373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.226317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.226832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.227251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.228082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.228554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.230134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.241001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.247307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 429/861] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:48.247307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.259224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71cfe5-ced4-41d3-90a2-b3aebeba9dba None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.293872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.294483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.294796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.295072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.295798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.296010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.297394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.309632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 433/862] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:48.310315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.349337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d846297-ddc3-4fec-8b5a-36aa709755ed None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.383613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.384219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.384498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.385365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.385994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.386299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.387697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.391963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 430/863] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:48.392728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.404622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.415257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50f7fa-6c48-4257-b279-a68a51e46ce8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.457093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.457700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.457985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.458317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.459098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=64379c68ad5d4aa989691e3dcbdb1900) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.459524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.461134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.479014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 434/864] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/role_assignments?user.id=64379c68ad5d4aa989691e3dcbdb1900&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:48.479014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.497250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.536137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103052b6-5519-4be9-935f-79c9007e6fda None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.582187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.583306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.583789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.584257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.585059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.586831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:48.597201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:48.598217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:48.599129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:48.601825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 431/865] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:48.608759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.627485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ddf8-ed81-4cab-862d-42bd66a82d6f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.671546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.673072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.673072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.673072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.680811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.682818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:48.694601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:48.695539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:48.696497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 435/866] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:48.701639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.709611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.765449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205474-4d58-41b3-bc9f-f6341c7a7842 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.795323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:48.814172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.815427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.816172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.817040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.818149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.819238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.821510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.823335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b3075-0d39-4ae5-a047-9a5e252c7b64 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:48.833562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 432/867] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:48.835984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.868790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:48.869981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:48.870263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:48.870532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:48.873495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:48.873820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:48.875663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:48.896255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 436/868] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:48.898043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:48.969933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bd678-9de8-49d2-bb91-3a89e496c9f7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:49.017657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:49.018191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:49.018465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:49.018763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:49.019393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:49.019694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:49.021047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae2d61-508a-45ae-a829-c4193e9707ae None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:49.023233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:49.027763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f788c6-1477-46dd-bc73-669bdefd422f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:49.028130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 433/869] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:49.068122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:49.068746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:49.069026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:49.069297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:49.070032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=67819b0ba6554d5980f1c6458f3e98f8) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:49.070342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:49.071836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e635-d7b7-4885-a2d8-bb66f1b62559 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:49.073991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:49.079348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 437/870] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:48 2022] GET /identity/v3/role_assignments?user.id=67819b0ba6554d5980f1c6458f3e98f8&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:50.356716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538463-a914-4737-a086-283c95507d14 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.357237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538463-a914-4737-a086-283c95507d14 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.357344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538463-a914-4737-a086-283c95507d14 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.359106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 434/871] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:50.364441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9141-3f9c-4746-ac36-9d7da99eadaa None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.364868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9141-3f9c-4746-ac36-9d7da99eadaa None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.365078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9141-3f9c-4746-ac36-9d7da99eadaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.383427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c3ae9141-3f9c-4746-ac36-9d7da99eadaa None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:50.385160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c3ae9141-3f9c-4746-ac36-9d7da99eadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:50.452659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 438/872] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:50.511627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d671c4-f368-467c-8e73-2aa1ae8e0612 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.511945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d671c4-f368-467c-8e73-2aa1ae8e0612 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.512214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d671c4-f368-467c-8e73-2aa1ae8e0612 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.513824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 435/873] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:50.519972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.520264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.520547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.539202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:50.540393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:50.608066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 439/874] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:50.737545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d671c4-f368-467c-8e73-2aa1ae8e0612 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:50.850168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d671c4-f368-467c-8e73-2aa1ae8e0612 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:50.879776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:50.886190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2cfe-9a54-4b7f-a59e-8a3fa14709af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:50.886820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2cfe-9a54-4b7f-a59e-8a3fa14709af None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.887099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2cfe-9a54-4b7f-a59e-8a3fa14709af None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.887366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2cfe-9a54-4b7f-a59e-8a3fa14709af None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.888024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2cfe-9a54-4b7f-a59e-8a3fa14709af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:50.889514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2cfe-9a54-4b7f-a59e-8a3fa14709af None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:50.911376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 436/875] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:37:50 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:50.949640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:50.968377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473cf7-b918-4d64-b923-072d77af5e7c None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.968727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473cf7-b918-4d64-b923-072d77af5e7c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.968926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473cf7-b918-4d64-b923-072d77af5e7c None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.970334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 437/876] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:50.976733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d595-c4de-4e77-8c9e-a160144d356e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:50.977023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d595-c4de-4e77-8c9e-a160144d356e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:50.977289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d595-c4de-4e77-8c9e-a160144d356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:50.997850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-eda3d595-c4de-4e77-8c9e-a160144d356e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:50.999155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-eda3d595-c4de-4e77-8c9e-a160144d356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:50.999762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d98428-d7f6-4239-9189-7e16b3ad1f20 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:51.051676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:51.052363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.052818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.053104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.053707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:51.055371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:51.066353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:51.067391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:51.068223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 440/877] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:51.073667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:51.074114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:51.089582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 438/878] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:51.140230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2c92-d890-4814-b336-ccc0ca89580a None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.140809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2c92-d890-4814-b336-ccc0ca89580a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.141083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2c92-d890-4814-b336-ccc0ca89580a None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.146783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 439/879] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:37:51.148462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.148747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.149021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.173399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:51.175383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:51.195638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60b57-3032-412b-be76-a3a4efa7a37a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:51.219948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:51.241970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:51.242700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.243076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.243355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.244018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:51.244321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:51.245683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:51.251478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 441/880] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:37:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:51.257689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:51.267870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 440/881] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:37:51.369959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:51.370564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b7fb-b05b-46bf-a345-eaee85c2c03e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:51.420463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:51.421037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.421328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.421606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.422716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:51.423034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:51.424396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:51.430983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 442/882] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:37:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:51.484673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfdc03-1382-4d21-be63-dbfea306cc6e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:51.510395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:51.528193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:51.529190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.529664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.530133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.531044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:51.532813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:51.544979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:51.553808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 441/883] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:37:51 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:37:51.614276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:51.676984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfef38-73f8-4af9-8bbb-fb238cd12f18 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:51.718887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:51.719519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.719800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.720128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.730539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:51.735670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:51.736578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:51.737404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 443/884] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 12 11:37:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:51.742677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:51.851325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838ed03-aacf-4c58-9b11-92545f30caa5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:51.887168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:51.887776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:51.888048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:51.888317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:51.888979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:51.889285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:51.890644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:51.904129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 442/885] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:37:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:51.905593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:52.012328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104afa7a-8fb1-4274-8abc-1a95108acfa7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:52.013816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:52.055230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:52.056249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.056770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.057258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.068344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:52.070018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:52.085004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:52.085971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:52.086984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:52.086984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:52.086984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:52.089553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 444/886] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:52.096019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:52.140448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:52.199525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f218-015c-47e8-ae22-7bae84af86bf None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:52.233350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:52.233948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.234228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.234495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.235167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:52.235594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:52.236943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:52.253399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 443/887] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:52.254756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:52.356669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196088e6-3266-480a-b51f-7a7dec4d62bb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:52.391369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:52.392634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.393086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.393500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.401205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:52.402796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:52.413960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:52.415064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:52.421501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 445/888] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:37:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:52.423717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:52.529482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da80344-4964-4e3c-acb4-08931f752679 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:52.532256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:52.568513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:52.569570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.570060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.570552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.571620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:52.572679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:52.574527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c9af8-9d27-40bf-a55f-d02e4a6e7e11 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:52.598827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 444/889] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 12 11:37:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:52.603684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:52.620061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:52.709361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaac370-1768-472c-aa8f-5e1755431bd8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:52.744922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:52.745806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.746227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.746667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.820046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:52.821748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:52.838272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:52.891044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4a3c-68eb-4ff9-870b-22cae9720883 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.891334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4a3c-68eb-4ff9-870b-22cae9720883 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.891613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4a3c-68eb-4ff9-870b-22cae9720883 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.893202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 445/890] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:52.898059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:52.898342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:52.898633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:52.917729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:52.919662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:52.934698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 446/891] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:37:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:37:52.939288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.015613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 446/892] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:37:53.054285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f65a8b-f759-4264-b857-70c09bcb6c67 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.068869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:53.091329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.092262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.092738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.093201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.104624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.106293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:53.120741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:53.121709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:53.122647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:53.122647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:53.122647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:53.129008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 447/893] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:53.130567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.226052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:53.236993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae18fe-2f8a-4d6d-b643-20fc248b6499 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.279478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.280593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.281092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.281624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.282479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:53.283218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.284854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.302712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 447/894] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:53.305634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.307907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.419269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bd615-96b4-4a1d-aed2-2ee314813fff None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.444544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d455a-e78b-4332-af8a-2c6da77769b6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.456656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.457295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.457574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.457857 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.458445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.459869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-f7e798ab-5740-4a63-8f53-145f529736dc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:53.469156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:53.470128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:53.471007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 448/895] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:53.472473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fb34-027a-4292-816a-b26e9930a002 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.472473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fb34-027a-4292-816a-b26e9930a002 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.472473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fb34-027a-4292-816a-b26e9930a002 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.473464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 449/896] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:53.477973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2fb34-027a-4292-816a-b26e9930a002 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.488511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.489346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.489464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.489691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.495092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:53.497016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.498460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-4ad826f4-974f-4a7e-b36a-b3f2b20f36fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:53.511194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:53.512133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 448/897] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.513894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.514493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.532765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:53.533934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:53.556992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:53.593841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2fb34-027a-4292-816a-b26e9930a002 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.611779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 449/898] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:53.612497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.642853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.643705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.644030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.644245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.644898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:53.645175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.646524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073541bc-1e5e-4398-9af9-a04946d2ee49 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.655678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 450/899] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:53.655678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabef2-bc60-4b8e-8c53-4b704b709bb7 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.655678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabef2-bc60-4b8e-8c53-4b704b709bb7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.655678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabef2-bc60-4b8e-8c53-4b704b709bb7 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.655678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 451/900] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:53.657257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfabef2-bc60-4b8e-8c53-4b704b709bb7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.721403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94d61-8abb-40cc-ba08-78f8a7ebf8e8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.741475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:53.756038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.756646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.756923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.757195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.757871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:53.758173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.760156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ce56-2a26-4886-8eb1-4ce42fb87361 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.766557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfabef2-bc60-4b8e-8c53-4b704b709bb7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.772239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 450/901] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:53.773546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500625ce-330e-42d7-9556-560f295080c9 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.774017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500625ce-330e-42d7-9556-560f295080c9 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.774446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500625ce-330e-42d7-9556-560f295080c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.793450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-500625ce-330e-42d7-9556-560f295080c9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:53.794686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-500625ce-330e-42d7-9556-560f295080c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:53.806074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:53.806550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.807245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.807524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.807941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.808780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:53.809089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.810435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.816335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 452/902] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:53.817661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.868930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 451/903] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:53.880032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500625ce-330e-42d7-9556-560f295080c9 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.937054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811c1a-7a6a-40e6-bc7f-2dda3014161f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:53.972710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:53.973828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:53.974771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:53.975383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:53.976381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] RBAC: Adding query filter params (role.id=79d43487162d41e492fce09a105c7f2c, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=67819b0ba6554d5980f1c6458f3e98f8) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:53.977082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:53.979135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:53.986921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 453/904] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/role_assignments?user.id=67819b0ba6554d5980f1c6458f3e98f8&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79d43487162d41e492fce09a105c7f2c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:53.988453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:53.993436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500625ce-330e-42d7-9556-560f295080c9 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.007162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:54.034870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.035594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.035942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.036282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.037070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] RBAC: Adding query filter params (interface=public, service_id=ff4b4754ea1d4301b7819d1a314765a1, region_id=RegionOne) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:54.037631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.038996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.052633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 452/905] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:37:53 2022] GET /identity/v3/endpoints?service_id=ff4b4754ea1d4301b7819d1a314765a1&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:54.054101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:54.070503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:54.140731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e500b-e721-4cef-bd26-3e0abd07ff39 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.176552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26eac-784f-418e-ac4c-8851bfe8649e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.182527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.183167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.183451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.183730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.184384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.185762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.201666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 454/906] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:37:53 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:54.202927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:54.219586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.220218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.220501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.220778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.221406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.222925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.230648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 453/907] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:37:54 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:37:54.302881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:54.347826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ace90-168c-4456-83b9-f86d76aa6b0a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.388312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.388997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.389259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.389580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.390238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.391634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:54.401246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:54.402399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:54.403511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 455/908] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 12 11:37:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:54.410312 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:54.488212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:54.522778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270e282-1f42-4524-b7e4-e270a90b523a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.558386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.559027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.559311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.559641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.560278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:54.560633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.562070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.567359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 454/909] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:54.575706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:54.687653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab85d7e-f449-4722-80a4-333b45cb7ee5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.718963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:54.724011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.724622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.724902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.725176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.725827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:54.726123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.727518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.732859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 456/910] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:54.738789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:54.849522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e02b0-37cb-4f18-947c-8dfb970a5199 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:54.897883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:54.898496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:54.898810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:54.899088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:54.899801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] RBAC: Adding query filter params (interface=public, service_id=38f962f20e4547e4bd499212b3c70996, region_id=RegionOne) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:54.900171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:54.902026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ba85a-d070-4aa3-b90a-62520b78f24b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:54.903542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:54.908380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 455/911] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:37:54 2022] GET /identity/v3/endpoints?service_id=38f962f20e4547e4bd499212b3c70996&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:54.913621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:55.023542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa966-20bc-4d98-bf1d-5ffbdf692dac None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:55.059458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455f48-98ac-4373-9349-e521416cb523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:55.060061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f48-98ac-4373-9349-e521416cb523 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:55.060341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f48-98ac-4373-9349-e521416cb523 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:55.060615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f48-98ac-4373-9349-e521416cb523 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:55.061225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a455f48-98ac-4373-9349-e521416cb523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:55.062585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a455f48-98ac-4373-9349-e521416cb523 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:55.068929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 457/912] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:37:54 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:37:55.958777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf11be-02f6-4e96-86f7-a6056f921971 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:55.959790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf11be-02f6-4e96-86f7-a6056f921971 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:55.960273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf11be-02f6-4e96-86f7-a6056f921971 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:55.962079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 456/913] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:55.967636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849711a-8578-47d4-bc7d-7710130e5dd3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:55.968440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849711a-8578-47d4-bc7d-7710130e5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:55.968984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849711a-8578-47d4-bc7d-7710130e5dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:55.987390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4849711a-8578-47d4-bc7d-7710130e5dd3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:55.988887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4849711a-8578-47d4-bc7d-7710130e5dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:56.045419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:56.070757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 458/914] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:56.158548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f66f2-bad8-45d4-a9b2-6b30571603b3 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.158766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f66f2-bad8-45d4-a9b2-6b30571603b3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.159030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f66f2-bad8-45d4-a9b2-6b30571603b3 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.160640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 457/915] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:56.166845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c53c-1da7-497e-b1fc-fd4bb5447fd9 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.167494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c53c-1da7-497e-b1fc-fd4bb5447fd9 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.167977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c53c-1da7-497e-b1fc-fd4bb5447fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.188287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6b68c53c-1da7-497e-b1fc-fd4bb5447fd9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:56.189822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6b68c53c-1da7-497e-b1fc-fd4bb5447fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:56.258441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 459/916] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:37:56.287488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de873-b819-4ce2-a3b1-b7dcf798d2f8 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.287778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de873-b819-4ce2-a3b1-b7dcf798d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.288046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de873-b819-4ce2-a3b1-b7dcf798d2f8 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.289613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 458/917] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:56.295209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.295499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.295777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.314467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:56.315686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:56.349171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de873-b819-4ce2-a3b1-b7dcf798d2f8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.387777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 460/918] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:56.454236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de873-b819-4ce2-a3b1-b7dcf798d2f8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:56.489824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:56.490476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.490760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.491034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.501668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:37:56.506330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:56.507561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:37:56.508679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:56.512049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 459/919] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:56.514221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.535997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.567987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:56.605065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:56.647540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18ca9-3c7a-4925-af41-64e73dfd5af4 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:56.650757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959274-cee0-4f30-8fe8-74d83cfc07d7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:56.687442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:56.688669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.689135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.689586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.690341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:56.691823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:56.692105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:56.692430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.692708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.692993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.693643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:56.693944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:56.695319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:56.703443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 461/920] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:56.703443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:56.705229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:56.706232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:37:56.707152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:56.713101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 460/921] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:56.713961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.814931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabcfce-253e-477c-9f46-8b7d905dcfd9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:56.821422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eedb4c-cfbe-463f-af9e-0fb1d5e11340 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:56.825403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:56.846731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:56.852057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:56.852695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.852975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.853303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.854377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:56.855781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:56.864603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:56.865239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:56.865517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:56.865786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:56.867161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:56.868125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:56.875245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 462/922] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:56.876044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.878564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:56.880068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:56.893897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:56.894900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:56.895788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:56.895788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:56.895788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:56.895788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 461/923] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:56.895788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:56.983211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3086c2-1aeb-4726-924c-d4ea4f827ea3 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.002072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2a528-3f7d-4039-8edb-c94ce47371f3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.016463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.017071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.017352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.017623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.018254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.018561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.019948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.024570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 463/924] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.025377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.041951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.042561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.042873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.043156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.043781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.044085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.045435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.050368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 462/925] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:37:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.051406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.074804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.093833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.134412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139c03-8531-47ec-87fb-75fc6eb723d8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.152615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30c84f-9ffa-4637-a727-efc55d184fb9 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.166999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.167613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.167892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.168163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.168826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.169127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.170482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.182673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 464/926] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.183459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.191390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.191992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.192270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.192544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.193177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.193483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.194867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b474dc7-548e-48cd-9dc4-3379a87ca1fc None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.199937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 463/927] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.201050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939fe8-38bf-4eed-b5aa-344e0cd8f019 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.201336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939fe8-38bf-4eed-b5aa-344e0cd8f019 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.201611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939fe8-38bf-4eed-b5aa-344e0cd8f019 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.204703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 464/928] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:57.204703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939fe8-38bf-4eed-b5aa-344e0cd8f019 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.277199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.281189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907c972-55e6-4f4d-aab0-dee3359adf93 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.303133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939fe8-38bf-4eed-b5aa-344e0cd8f019 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.304618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.314965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.315564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.315847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.316120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.316745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.317052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.318419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.323110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 465/929] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.323858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.341961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.342579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.342885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.343153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.349960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.351396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-32ed5347-2427-4890-92ed-96c62adb94a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:37:57.362985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:57.364108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 465/930] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:57.365258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.366062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.366062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.382637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:57.383837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:57.422536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef77909-0b6b-4385-9dfd-de36489ea88c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.448837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 466/931] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:57.449858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.455994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.456590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.456863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.457129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.457779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.459162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.482877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 466/932] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:37:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:37:57.483867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.512574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.604061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.614631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11120-5a53-4e6b-807f-dc97d483b73c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.629761 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28a427-0fb7-43a0-a3b9-4d8ded7ce483 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.654495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.655449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.655838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.656122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.656819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] RBAC: Adding query filter params (interface=public, service_id=3203e1df025f4f51a5279d482e28bf7d, region_id=RegionOne) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.657125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.658586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.664274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 467/933] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/endpoints?service_id=3203e1df025f4f51a5279d482e28bf7d&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.669941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.673359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.674231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.674735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.675183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.676118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:57.676901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.678325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.697760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 467/934] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:57.703108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.781997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474b1b-cebe-4229-bcd6-c1bd0d1fd63a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.786320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.818490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.819124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.819435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.819682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.819783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3b57-d020-4f82-bff5-b374d9e76f5c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:57.820286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.821641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.834645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 468/935] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:37:57.834645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.862141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:57.875158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:57.875936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:57.876288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:57.876633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:57.891934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:57.893607 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:37:57.911133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:57.912277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:37:57.913175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:37:57.913175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:37:57.913175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:57.918013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 468/936] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:57.918989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:57.971746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe92c-8f59-4be5-9b0e-4805e5ae80b2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.018163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.019148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.019430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.019704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.020443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.022395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:58.035143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:58.036128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:37:58.037060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 469/937] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:37:58.037870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772c730-3ed7-431e-a571-0c9d0862cef6 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.044270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:58.071034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:58.081329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.082052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.082388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.082696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.083360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:58.083666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.085091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.098287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 469/938] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:58.104053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:58.133202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:58.149996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ca32-8ab5-46cd-9ae0-4d1af9b816ee None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.185723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.186475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.186854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.187206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.187915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:58.188339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.189778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.200257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 470/939] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:58.201266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:58.212358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f2d53-af75-4dc2-878f-f245818da9bf None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.250105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.250777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.251058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.251334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.258704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.260374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:37:58.272108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:37:58.273035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:37:58.273933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:37:58.278966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 470/940] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:37:58.279942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:58.306027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77467aab-8c5f-4451-8b34-fafe8f98a8c6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.337209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:58.347547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.348164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.348444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.350349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.350349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:58.350349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.351012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.360402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 471/941] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:37:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:37:58.365539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:58.391086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:58.398895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992427-18a0-4718-b923-2a0ac12431b9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.435793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.437075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.437557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.438030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.438977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:37:58.439588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.441222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.459091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 471/942] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:37:58.461547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:58.468226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacd818-880c-4951-9ab0-e7c9487bc743 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.502467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d8412-5023-4d24-add4-11785eeff9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.503136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8412-5023-4d24-add4-11785eeff9fb None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.503417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8412-5023-4d24-add4-11785eeff9fb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.503701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8412-5023-4d24-add4-11785eeff9fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.504356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d8412-5023-4d24-add4-11785eeff9fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.505720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d8412-5023-4d24-add4-11785eeff9fb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.543067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 472/943] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:37:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:37:58.585042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6416-594c-4971-b33a-9f058a477ae0 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:37:58.589242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:58.634036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb619-5449-42d5-9b1f-b8313e71405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:37:58.635700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb619-5449-42d5-9b1f-b8313e71405d None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:58.636183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb619-5449-42d5-9b1f-b8313e71405d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:58.636995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb619-5449-42d5-9b1f-b8313e71405d None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/67819b0ba6554d5980f1c6458f3e98f8/roles/79d43487162d41e492fce09a105c7f2c` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:58.641042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb619-5449-42d5-9b1f-b8313e71405d None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=67819b0ba6554d5980f1c6458f3e98f8, role_id=79d43487162d41e492fce09a105c7f2c)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:37:58.643722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb619-5449-42d5-9b1f-b8313e71405d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:37:58.663847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 472/944] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:37:58 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/67819b0ba6554d5980f1c6458f3e98f8/roles/79d43487162d41e492fce09a105c7f2c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:37:59.484347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e798-d843-4d56-af9a-e183a39bdbb2 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:59.484897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e798-d843-4d56-af9a-e183a39bdbb2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:59.484897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e798-d843-4d56-af9a-e183a39bdbb2 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:59.486564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 473/945] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:59.491715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed208-c6fe-4fee-8db6-acec83bc79ff None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:59.492493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed208-c6fe-4fee-8db6-acec83bc79ff None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:59.492965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed208-c6fe-4fee-8db6-acec83bc79ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:59.512060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-34eed208-c6fe-4fee-8db6-acec83bc79ff None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:59.513586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-34eed208-c6fe-4fee-8db6-acec83bc79ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:59.586435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 473/946] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:59.841965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1912d-1a4e-4fc5-82b1-a142f0ba21e6 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:59.842311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1912d-1a4e-4fc5-82b1-a142f0ba21e6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:59.842525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1912d-1a4e-4fc5-82b1-a142f0ba21e6 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:59.844146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 474/947] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:37:59.849277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:37:59.849571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:37:59.849847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:37:59.854131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1912d-1a4e-4fc5-82b1-a142f0ba21e6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:37:59.879451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:37:59.880867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:37:59.932269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:37:59.965470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 474/948] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:37:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:37:59.983465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1912d-1a4e-4fc5-82b1-a142f0ba21e6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.019724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.021011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.021512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.021987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.022875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.024509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.027889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING keystone.server.flask.common [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 11:38:00.048223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.sql.core [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:38:00.048223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 11:38:00.048223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [parameters: {'id': 'd785ff1d40644e4aadfb5c44e714d43e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 11:38:00.048223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d785ff1d40644e4aadfb5c44e714d43e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d785ff1d40644e4aadfb5c44e714d43e. Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:38:00.065987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result.read() Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 12 11:38:00.066875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application yield resource Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise self.value Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application session.commit() Aug 12 11:38:00.067855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:38:00.068763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:38:00.069672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result.read() Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:38:00.070468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [parameters: {'id': 'd785ff1d40644e4aadfb5c44e714d43e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.073575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:00.075566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d785ff1d40644e4aadfb5c44e714d43e. Aug 12 11:38:00.077495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.080486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 475/949] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Aug 12 11:37:59 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:00.086709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.127047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:00.199620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c41422-23e9-4ffa-acc6-b18e7435a1b0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.236080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.237062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.237582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.238075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.240309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.247553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.249261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:38:00.265271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:00.266269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:00.267200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:00.270687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 475/950] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:00.274177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.360507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7b35a-e387-4147-9757-47fee15f80f8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.379450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:00.393661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:00.402773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd963aab-48f2-4a1e-b9fa-74a824536572 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.411012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.411967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.412470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.413291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.414084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.417282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:00.428964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:00.429978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:00.430869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:00.432430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 476/951] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:38:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:00.439390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.445722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.446359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.446663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.447130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.447805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:00.448103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.449521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e578-36bc-498c-9094-e489028768b9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.474688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 476/952] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:00.523231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975aa47-cd5e-4a01-81a3-fd9c647a3bd4 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.524180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975aa47-cd5e-4a01-81a3-fd9c647a3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.524698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975aa47-cd5e-4a01-81a3-fd9c647a3bd4 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.527228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 477/953] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:38:00.536433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b096-f325-4f30-a110-4ca41de79509 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.537075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b096-f325-4f30-a110-4ca41de79509 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.537557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b096-f325-4f30-a110-4ca41de79509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.559640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-5327b096-f325-4f30-a110-4ca41de79509 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:00.561256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5327b096-f325-4f30-a110-4ca41de79509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:00.561372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c3c2-609a-4813-908e-9937f397afd2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.598971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.599602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.599884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.600160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.600810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:00.601121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.602521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.615545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 477/954] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:38:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:00.617775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.657799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 478/955] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:00.659380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a02e2-97d1-46a1-a365-3ea5367f94cb None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.659668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a02e2-97d1-46a1-a365-3ea5367f94cb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.659944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a02e2-97d1-46a1-a365-3ea5367f94cb None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.661294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 479/956] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:00.672352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.672970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.673447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.685708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:00.693411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:00.694625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:00.751830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa176c21-ee15-4d48-9e03-62d5b426f053 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.774452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:00.782569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 480/957] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:38:00.791965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.792644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.792910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.793190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.793821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:00.794121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.795573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.800962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 478/958] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:38:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:00.807777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.926074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fea9-ed63-48bd-9045-4aa4b592c68d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:00.944534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:00.965672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:00.967031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:00.967491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:00.967940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:00.968809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:00.970380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:00.997616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 481/959] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:38:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:01.061989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.080429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933a7d-d640-4950-bce5-0df65ae86f03 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.101618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:01.132052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.133111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.133567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.134009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] PATH_INFO: `/v3/services/compute` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.135540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.137178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:01.147613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:01.148743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:01.149628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:01.150518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:01.152342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 479/960] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:01.157902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.201687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097732f6-e91d-491e-86d9-2930db1991ed None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.238519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.239244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.239638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.239918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.254023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:01.259352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:01.260498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:01.261512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 482/961] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:01.271538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.279683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76d8b-d7c8-4998-87ab-b2e9c260841e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.321430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.322440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.322952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.323376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.324203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] RBAC: Adding query filter params (name=compute) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:01.324718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.326344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:01.332071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 480/962] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:01.337176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.385738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:01.407557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49509700-ae3d-4e9d-9624-2660fbd774c5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.430365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:01.450272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031afcb-fd5b-4fa4-b1a2-9109f826a33c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.455128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.455913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.456339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.456768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.457601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:01.458505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.460522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:01.471604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 483/963] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:01.476733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.497917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.499406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.499873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.500621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.501688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] RBAC: Adding query filter params (type=compute) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:01.502599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.504686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:01.513644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 481/964] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:01.590136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ede38-0064-4c0a-90b7-353a33a4e9f7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.627728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.628731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.629191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.629643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.642544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.644332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:01.664830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:01.665912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:01.666892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:01.666892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:01.666892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:01.666892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 484/965] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:01.671844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.782310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f9800-4624-4560-999a-bd93bde6a01f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.785005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:01.817546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.818157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.818437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.818751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.819398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:01.819703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.821061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:01.833753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 482/966] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:01.839298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:01.870927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:01.945303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d207d36-1e16-4c18-8262-fd3cb1055b44 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:01.979897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:01.980527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:01.980806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:01.981077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:01.988813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:01.990261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:38:02.002157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:02.003180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:02.004153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 485/967] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:38:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:02.011537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:02.119905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809ed5-0493-40b9-bbb7-2a144978b74f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:02.155452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:02.156065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:02.156349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:02.156672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:02.157408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:02.157777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:02.159233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:02.179770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 483/968] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 12 11:38:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:02.186180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:02.280483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:02.291903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837b3fe-436f-472a-98f0-b4ef34537475 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:02.342895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f5cd9-c2bd-42a8-acaf-016c63f7ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:02.343510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f5cd9-c2bd-42a8-acaf-016c63f7ed5f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:02.343793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f5cd9-c2bd-42a8-acaf-016c63f7ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:02.344064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f5cd9-c2bd-42a8-acaf-016c63f7ed5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:02.414173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f5cd9-c2bd-42a8-acaf-016c63f7ed5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:02.416037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f5cd9-c2bd-42a8-acaf-016c63f7ed5f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:02.509053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:02.520861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 486/969] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:38:02.529704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:02.556740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:02.602783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d14ca-656c-4539-8d0f-9ee8894ce022 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:02.603376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d14ca-656c-4539-8d0f-9ee8894ce022 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:02.603542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d14ca-656c-4539-8d0f-9ee8894ce022 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:02.605050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 487/970] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:02.611069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8466f-f247-4617-bade-e232b279195b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:02.612002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8466f-f247-4617-bade-e232b279195b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:02.612002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8466f-f247-4617-bade-e232b279195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:02.630299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b3a8466f-f247-4617-bade-e232b279195b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:02.631505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b3a8466f-f247-4617-bade-e232b279195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:02.643256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6dc60-09c2-43e9-bbe1-23971ac22519 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:02.684799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:02.685413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:02.685673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:02.685898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:02.697488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:02.698941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:02.714816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:02.715820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:02.716727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:02.716727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:02.716727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:02.720601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 484/971] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:02.721463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 488/972] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:02.722222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:02.803895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:02.831940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101367aa-47b0-4597-bb31-67b0b75b9827 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:02.874584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:02.875485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:02.875986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:02.876474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:02.877321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:02.877843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:02.879482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:02.892956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 485/973] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:02.902926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8466f-f247-4617-bade-e232b279195b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.004943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.006217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8466f-f247-4617-bade-e232b279195b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.027343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:03.045240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.045866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.046144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.046415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.053820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.055301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:38:03.067233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:03.068175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:03.069101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 489/974] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:03.075550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.121657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1ed59-4321-49e6-9806-f825a4a73aab None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.159899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.160507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.160778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.161049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.161720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.163355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.172314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:03.179403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.sql.core [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:38:03.179403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 11:38:03.179403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [parameters: {'user_id': 'fd827d1004fd4a41b068deea5295fc09', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 11:38:03.179403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-17802bf0-bf59-42a9-a58c-aed77f88a293 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result.read() Aug 12 11:38:03.188528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:38:03.189464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application yield resource Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise self.value Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application session.commit() Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:38:03.190560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:38:03.191636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:38:03.192655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application result.read() Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:38:03.193653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fd827d1004fd4a41b068deea5295fc09', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:03.194693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 12 11:38:03.195657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 12 11:38:03.197252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 12 11:38:03.197252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 12 11:38:03.197252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:38:03.197252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:38:03.197252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 11:38:03.197252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:03.197746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abb25a-7e3b-4e33-90b5-352ce4713c0b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.200100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 486/975] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 12 11:38:03 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:03.201946 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772c47-400f-44bf-a464-bf869b291414 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.202386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772c47-400f-44bf-a464-bf869b291414 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.202824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772c47-400f-44bf-a464-bf869b291414 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.207177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 487/976] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:03.208062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13772c47-400f-44bf-a464-bf869b291414 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.236725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.237349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.237597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.237859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.238549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:03.238881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.240563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3c527-76c2-41c2-8b14-85ba0f6d468c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.257844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 490/977] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:03.259078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.260115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.260225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.279337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:03.280510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:03.319246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:03.321064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13772c47-400f-44bf-a464-bf869b291414 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.353786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 491/978] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:03.354653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.368349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.369886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.370350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.370838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.379272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.381124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:38:03.394428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:03.395654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:38:03.396852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:03.404304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 488/979] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:03.405439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.463527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8a3eb-f2a0-4dee-aff6-8c76a23513d8 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.476070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:03.505159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.505765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.506049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.506318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.507084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] RBAC: Adding query filter params (role.id=79d43487162d41e492fce09a105c7f2c, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=67819b0ba6554d5980f1c6458f3e98f8) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:03.507391 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.508864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40e79-cde8-4d25-a5a9-2816f27fcd1e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.515709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 492/980] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:03 2022] GET /identity/v3/role_assignments?user.id=67819b0ba6554d5980f1c6458f3e98f8&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79d43487162d41e492fce09a105c7f2c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:03.516904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56ed09-45e9-4573-b9a2-d67bdd8a1923 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.517185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56ed09-45e9-4573-b9a2-d67bdd8a1923 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.517458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56ed09-45e9-4573-b9a2-d67bdd8a1923 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.523807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 493/981] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:03.525770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.526056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.526333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.538666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe445c-2971-4359-b9a4-665fc08994c0 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.553987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:03.555571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:03.587725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.588987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.590002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.590810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.592112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:03.593112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:03.593622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.596316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.647426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 494/982] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:03.648309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.665125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 489/983] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 12 11:38:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:03.767573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5929cf-88de-440f-a4aa-ea2df28a899d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.807689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:03.808585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:03.809014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:03.809453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:03.810207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:03.811829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:03.821916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:03.823009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:03.823992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 495/984] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:38:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:03.829187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.925875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:03.951759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e74fc-89c5-4759-8e4d-14baa1336bb1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:03.964373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:03.971292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:04.001155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:04.001771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:04.002056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:04.002336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:04.003098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:04.003489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:04.005105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:04.017324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 490/985] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:38:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:04.018355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:04.043152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3b934-c6cb-4cd7-9509-6239a5880b19 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:04.078130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:04.078771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:04.079164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:04.079466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:04.080105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:04.081461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:04.102831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 496/986] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:38:03 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:38:04.127321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037110-1086-44b0-be26-581c80a486b1 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:04.171360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:04.171979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:04.172257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:04.172528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:04.173190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:04.173492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:04.174904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:04.183752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 491/987] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:38:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:04.189792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:04.284699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:04.297856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099319-5888-4e05-9746-5a1afa1bb14e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:04.333134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:04.333750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:04.334030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:04.334303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:04.335049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] RBAC: Adding query filter params (interface=admin, service_id=3203e1df025f4f51a5279d482e28bf7d, region_id=RegionOne) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:04.335362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:04.336762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf779-cf02-4374-b3b6-41cb1db16f08 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:04.342150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 497/988] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Aug 12 11:38:04 2022] GET /identity/v3/endpoints?service_id=3203e1df025f4f51a5279d482e28bf7d&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:04.349699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:04.393971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:04.455834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b2fd-b053-4eed-bc5a-f30d74efc2ea None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:04.489597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8b36-1032-4011-82e6-d0a693294653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:04.490204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8b36-1032-4011-82e6-d0a693294653 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:04.490484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8b36-1032-4011-82e6-d0a693294653 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:04.490787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8b36-1032-4011-82e6-d0a693294653 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:04.491395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8b36-1032-4011-82e6-d0a693294653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:04.492746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8b36-1032-4011-82e6-d0a693294653 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:04.499652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 492/989] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:38:04 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:38:05.528060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e7f5-a6bb-4223-8623-56979b1e33db None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:05.528608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e7f5-a6bb-4223-8623-56979b1e33db None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:05.528608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e7f5-a6bb-4223-8623-56979b1e33db None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:05.530079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 498/990] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:05.535003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f6d25-8cef-4360-8421-f096802b3837 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:05.535387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f6d25-8cef-4360-8421-f096802b3837 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:05.535555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f6d25-8cef-4360-8421-f096802b3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:05.554466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9b7f6d25-8cef-4360-8421-f096802b3837 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:05.556012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9b7f6d25-8cef-4360-8421-f096802b3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:05.626803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 493/991] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:05.893326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e7f5-a6bb-4223-8623-56979b1e33db None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.001131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e7f5-a6bb-4223-8623-56979b1e33db None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.012266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4217-77aa-4071-9f4e-fe7ceff9633c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.012550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4217-77aa-4071-9f4e-fe7ceff9633c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.012822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4217-77aa-4071-9f4e-fe7ceff9633c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.017999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 494/992] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:38:06.019444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.019785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.020132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.036233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:06.036868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.037147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.038638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] PATH_INFO: `/v3/services/image` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.038638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:06.039363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:06.041507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:06.043176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:06.048789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:06.049775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:06.050633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:06.055090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 499/993] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 12 11:38:05 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:06.055936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.077606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:06.078493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:06.134724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 495/994] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:06.167968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740df89-229d-4cbf-bef9-9bd0c29f5298 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.204034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:06.204732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.205083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.205428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.206133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] RBAC: Adding query filter params (name=image) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:06.206505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:06.208007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:06.218336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 500/995] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:06.219328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.337910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb0aed-9718-40e2-8a00-08cc22e2b505 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.372012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:06.372618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.372899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.373185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.373796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] RBAC: Adding query filter params (type=image) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:06.374098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:06.375482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dea16-cc47-4de6-9ef1-cdd64849db7d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:06.386947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 496/996] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:06.395352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.459477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa44a8-f88a-4956-9ac7-ea19562076f0 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.459854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa44a8-f88a-4956-9ac7-ea19562076f0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.460028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa44a8-f88a-4956-9ac7-ea19562076f0 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.461721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 497/997] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:38:06.468612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.468900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.469173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.487588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:06.492479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:06.493757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:06.511452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22a7a-8bc6-4d2f-b78b-8ecd560bc978 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.517607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:06.553086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:06.553717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.553992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.554262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] PATH_INFO: `/v3/services/compute` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.554887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:06.556807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:06.565444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:06.566776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:06.567637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 501/998] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:06.573029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.579076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 498/999] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:38:06.672515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8497-71e1-4e7b-ad71-592801a5520d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.708165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:06.708771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.709046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.709315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.709936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] RBAC: Adding query filter params (name=compute) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:06.710231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:06.711612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:06.721603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 502/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:06.723962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.829380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fc446-2eab-45c7-be5d-d8ed566adc20 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.854897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.867075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:06.867695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:06.867976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:06.868250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:06.868921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] RBAC: Adding query filter params (type=compute) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:06.869225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:06.872772 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:06.872913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:06.877275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 499/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:06.883077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:06.906778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:06.977640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3196c-5f40-4c83-9af5-41b9160ffd4a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:06.984209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f8326-20b9-4b08-979b-b956842e526e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:07.017533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:07.018205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:07.018488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:07.018810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:07.019498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] RBAC: Adding query filter params (interface=public, service_id=5202d2b504624c2ab1a5a7539c9fbaa3, region_id=RegionOne) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:07.019808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:07.021165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:07.034624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 500/1002] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/endpoints?service_id=5202d2b504624c2ab1a5a7539c9fbaa3&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:07.035774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:07.037215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:07.037911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:07.038194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:07.038501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:07.039127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:07.040508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:07.049718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:07.050796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:07.052215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 503/1003] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 12 11:38:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:07.057393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:07.128659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:07.131727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:07.148983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638847-bfd5-4a79-ab07-30750a8ca83a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:07.160963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d040c-1b9c-470d-9a4e-2b54c55fbe47 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:07.183917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:07.184531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:07.184814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:07.185087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:07.185686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:07.187069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:07.193559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 501/1004] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:38:07 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:38:07.196294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:07.197482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:07.197758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:07.198028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:07.198703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:07.199007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:07.200412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:07.210877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 504/1005] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:38:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:07.212013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:07.319329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd822-8c94-4f2b-8913-20ae9d762aac None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:07.356621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:07.357248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:07.357530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:07.357806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:07.358442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:07.358776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:07.360227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808d89-37ab-43a1-9863-dd188359f94b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:07.365992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 502/1006] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 12 11:38:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:07.372183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:07.475066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cc032-c706-460a-ac9f-304e424f0608 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:07.510634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eaab6-3d2d-4e81-b923-b71ccad0ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:07.511266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eaab6-3d2d-4e81-b923-b71ccad0ee18 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:07.511546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eaab6-3d2d-4e81-b923-b71ccad0ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:07.511820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eaab6-3d2d-4e81-b923-b71ccad0ee18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:07.512485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eaab6-3d2d-4e81-b923-b71ccad0ee18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:07.513850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eaab6-3d2d-4e81-b923-b71ccad0ee18 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:07.519770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:07.542637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 505/1007] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:38:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:08.308634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717670b-7cfd-406b-8bbf-2ee0fc8d3615 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:08.309130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717670b-7cfd-406b-8bbf-2ee0fc8d3615 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:08.309228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717670b-7cfd-406b-8bbf-2ee0fc8d3615 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:08.310677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 503/1008] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:08.315652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851cab-fb20-4f92-bb4d-30eb149eb329 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:08.316054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851cab-fb20-4f92-bb4d-30eb149eb329 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:08.316233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad851cab-fb20-4f92-bb4d-30eb149eb329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:08.334989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ad851cab-fb20-4f92-bb4d-30eb149eb329 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:08.336151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ad851cab-fb20-4f92-bb4d-30eb149eb329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:08.412474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 506/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:08.677791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717670b-7cfd-406b-8bbf-2ee0fc8d3615 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:08.693515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:08.783631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717670b-7cfd-406b-8bbf-2ee0fc8d3615 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:08.817091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136330-cb4b-4f9c-b926-d07df23ce3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:08.817693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136330-cb4b-4f9c-b926-d07df23ce3f4 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:08.817969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136330-cb4b-4f9c-b926-d07df23ce3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:08.818238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136330-cb4b-4f9c-b926-d07df23ce3f4 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:08.818915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f136330-cb4b-4f9c-b926-d07df23ce3f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:08.820265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f136330-cb4b-4f9c-b926-d07df23ce3f4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:08.836315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 504/1010] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:38:08 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:09.142783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f36-d273-4f8a-aaaf-f7386efd9b33 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.143165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f36-d273-4f8a-aaaf-f7386efd9b33 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.143350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f36-d273-4f8a-aaaf-f7386efd9b33 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.144837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 507/1011] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:09.150415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61bee-4415-4518-8acb-b08492e56f1d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.150745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61bee-4415-4518-8acb-b08492e56f1d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.151029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61bee-4415-4518-8acb-b08492e56f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.168999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8ac61bee-4415-4518-8acb-b08492e56f1d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:09.170186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8ac61bee-4415-4518-8acb-b08492e56f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:09.237953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:09.246746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 505/1012] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:09.429274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76010fc-172e-475a-9da7-a09e94db563e None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.429779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76010fc-172e-475a-9da7-a09e94db563e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.429779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76010fc-172e-475a-9da7-a09e94db563e None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.431764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 508/1013] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:09.436586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.436956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.437133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.455523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:09.456684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:09.522496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 506/1014] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:09.524472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76010fc-172e-475a-9da7-a09e94db563e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:09.624254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76010fc-172e-475a-9da7-a09e94db563e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:09.646547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:09.659235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:09.659860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.660140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.660413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] PATH_INFO: `/v3/services/compute` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.660994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:09.662348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:09.671388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:09.672400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:38:09.673255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:09.679273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 509/1015] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:09.679458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:09.778670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd88e84-78f6-46f9-b476-02f9c04fe9c2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:09.785109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:09.807455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:09.816264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:09.816872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.817201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.817482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.818108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:09.818409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:09.819794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:09.825006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 507/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:09.830148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:09.908968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1de77-81ba-4502-ac73-8a102d322bcd None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:09.937137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f6ae-302a-47c3-968f-c016e64e44e8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:09.948460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:09.949082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.949359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.949628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.950741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:09.952161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:09.953982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 510/1017] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:09.959296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:09.977722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:09.978875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:09.979154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:09.979428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:09.980055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] RBAC: Adding query filter params (type=compute) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:09.980356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:09.981694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:09.986888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 508/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 12 11:38:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:09.992416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:10.022426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:10.052577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:10.069589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e220-4da3-484f-8987-a6559b3a6b9c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:10.099227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d71a0-6d4c-4a6a-9f65-89f88765803b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:10.104430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c13f98-f998-448d-9e2b-74bcf88cc418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:10.105025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c13f98-f998-448d-9e2b-74bcf88cc418 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:10.105300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c13f98-f998-448d-9e2b-74bcf88cc418 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:10.105566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c13f98-f998-448d-9e2b-74bcf88cc418 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:10.106191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c13f98-f998-448d-9e2b-74bcf88cc418 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:10.107684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c13f98-f998-448d-9e2b-74bcf88cc418 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:10.134520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36ea4f-fa3b-4ab6-a564-8b0d95fcfead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:10.135187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36ea4f-fa3b-4ab6-a564-8b0d95fcfead None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:10.135448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36ea4f-fa3b-4ab6-a564-8b0d95fcfead None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:10.135727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36ea4f-fa3b-4ab6-a564-8b0d95fcfead None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:10.136378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36ea4f-fa3b-4ab6-a564-8b0d95fcfead None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:10.137739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36ea4f-fa3b-4ab6-a564-8b0d95fcfead None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:10.138213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 511/1019] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:38:09 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:10.163377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 509/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:38:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:38:10.753843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42992a48-f49c-4a8f-b882-4a93c110d34a None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:10.754370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42992a48-f49c-4a8f-b882-4a93c110d34a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:10.754370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42992a48-f49c-4a8f-b882-4a93c110d34a None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:10.755763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 512/1021] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:10.761381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:10.761848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:10.761927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:10.781240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:10.782429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:10.861639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 510/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:11.129581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42992a48-f49c-4a8f-b882-4a93c110d34a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:11.231640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42992a48-f49c-4a8f-b882-4a93c110d34a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:11.239048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:11.270868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:11.271511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:11.271792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:11.272068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] PATH_INFO: `/v3/services/image` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:11.272660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:11.274031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:11.283533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:11.284591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:11.286053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 513/1023] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 12 11:38:11 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:11.290488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:11.334019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:11.397299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33be15b-c6b5-4237-bce5-f0d7e00e665e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:11.431324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:11.431923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:11.432201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:11.432472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:11.433094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] RBAC: Adding query filter params (name=image) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:11.433390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:11.434758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:11.444095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 511/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:11.445043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:11.544875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edfc66-ea70-42d5-960d-f9e1d8772cb1 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:11.578390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:11.579009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:11.579284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:11.579550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:11.580200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] RBAC: Adding query filter params (type=image) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:11.580496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:11.581843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:11.590816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 514/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:11.592769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:11.691055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b2aa6-8b56-4fdd-9da9-10c106a46e2f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:11.692494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:11.726209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:11.726846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:11.727125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:11.727396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:11.728233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] RBAC: Adding query filter params (interface=public, service_id=9e0784223bcb4998a5757c6e6137b0c3, region_id=RegionOne) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:11.728541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:11.729881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7a63-a712-40f3-8798-ff6b7bdbc35c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:11.739686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 512/1026] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:38:11 2022] GET /identity/v3/endpoints?service_id=9e0784223bcb4998a5757c6e6137b0c3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:11.740627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:11.777550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:11.846719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cab64-5845-470a-82a3-fa193c10af74 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:11.887076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6448b-c2d0-4bba-aff3-8b8af37ee512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:11.887686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6448b-c2d0-4bba-aff3-8b8af37ee512 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:11.887962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6448b-c2d0-4bba-aff3-8b8af37ee512 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:11.888230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6448b-c2d0-4bba-aff3-8b8af37ee512 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:11.888841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6448b-c2d0-4bba-aff3-8b8af37ee512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:11.890198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6448b-c2d0-4bba-aff3-8b8af37ee512 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:11.902927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 515/1027] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:38:11 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:38:12.086464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158193ff-c929-4ba9-b53c-e9edbae0317c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.087009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158193ff-c929-4ba9-b53c-e9edbae0317c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.087088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158193ff-c929-4ba9-b53c-e9edbae0317c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.088561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 513/1028] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:12.093466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9070f-22c0-475b-8f87-306fe4e5e430 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.093756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9070f-22c0-475b-8f87-306fe4e5e430 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.094028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9070f-22c0-475b-8f87-306fe4e5e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.112398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6fe9070f-22c0-475b-8f87-306fe4e5e430 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:12.113574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6fe9070f-22c0-475b-8f87-306fe4e5e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:12.179765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 516/1029] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:12.192829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851c744-ddf4-40b7-bb31-9aa49f6dc68a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.193122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851c744-ddf4-40b7-bb31-9aa49f6dc68a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.193402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851c744-ddf4-40b7-bb31-9aa49f6dc68a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.194901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 514/1030] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:12.200225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.200513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.200786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.219001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:12.220156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:12.244314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:12.289973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 517/1031] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:12.451567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851c744-ddf4-40b7-bb31-9aa49f6dc68a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:12.551074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:12.553882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851c744-ddf4-40b7-bb31-9aa49f6dc68a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:12.588979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:12.589597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.589888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.590144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.591263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:12.592669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:12.594386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 515/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:12.599631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:12.636095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:12.654579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4571d83-bbe4-4d4b-af79-461d7d3d34be None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:12.687902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:12.688522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.688797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.689064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.699564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:12.704273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:12.705194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:12.707618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 518/1033] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 12 11:38:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:12.708321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c72e6c-b9d0-48b7-87ea-f8310ff70348 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:12.711034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:12.731357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:12.744537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:12.745151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.745426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.745708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.746346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:12.747798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:12.786663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 516/1034] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:38:12 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:38:12.822303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4615-e239-46fb-9add-99ad08d06c97 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:12.863087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:12.863716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:12.863998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:12.864271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:12.864953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:12.865258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:12.866679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:12.880800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 519/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:38:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:12.882077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:12.990124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:13.005084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387815-837a-4e41-8ac7-0b8e77b3281f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:13.040219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:13.040892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.041178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.041454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.052516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:13.053961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:13.068590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:13.069541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:13.070506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:13.070506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:13.070506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:13.070506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 517/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:13.076126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:13.157778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:13.177895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f91ca7-89ff-4623-9221-df9b8388fae8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:13.212035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:13.213151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.213427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.213696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.214335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:13.214651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:13.216013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:13.228616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 520/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:13.233972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:13.336209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47813783-5b8c-4ca8-be0c-109515ce4004 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:13.370407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:13.371079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.371362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.371642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.379096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:13.380522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:38:13.391954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:13.393319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:38:13.395231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:13.398648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 518/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:38:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:13.399162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:13.499333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb7adc-45a2-4ae7-aef0-8ca7481a64ba None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:13.532863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:13.533462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.533737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.534032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.534749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:13.535056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:13.536479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298a59e-f0f1-4ea3-8066-c14529ea67db None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:13.545476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:13.560501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 521/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:38:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:13.561733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:13.564619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:13.660590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140d1d-8b0f-4b66-beec-edaf34ee09d3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:13.693353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:13.693957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.694239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.694516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.760818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:13.762255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:13.764093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:13.804313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b77db-0c32-4f63-95c8-71147824befa None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.804600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b77db-0c32-4f63-95c8-71147824befa None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.804924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b77db-0c32-4f63-95c8-71147824befa None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.807032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 522/1040] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:38:13.812407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:13.812939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:13.813403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:13.832813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:13.834012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:13.874032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 519/1041] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:38:13.874985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:13.912566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 523/1042] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:38:13.978084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71789d-eaf4-4dc7-aed1-13af8809baa2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:13.979868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:14.014277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.014996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.015277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.015544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.026437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.027892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:14.043397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:14.044325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:14.045228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:14.045228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:14.045228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:14.046915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 520/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:14.050128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.150371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ff09-d5e9-4710-9e8e-4901d7db1585 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.177805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:14.179172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.187716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.188325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.188604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.188875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.189958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:14.190263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.192025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.204646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 524/1044] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:14.209874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.291625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ca904-90df-4a2d-a980-2344e56071ba None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.313396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e2e2d-32ce-43b5-9800-49fac0bfc62b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.327250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.327942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.328226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.328547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] PATH_INFO: `/v3/services/image` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.329131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.330732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:14.340258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:14.342791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:14.343875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 521/1045] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:14.347216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.353365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.353989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.354264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.354530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.361563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.363041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.367451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:38:14.375760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:14.376695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:14.377621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 525/1046] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:14.382541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.434282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:14.468481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae02b5-477a-4369-ab48-1828bec8388c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.491574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06508135-b5ad-4093-9908-a36af2b60a1b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.505397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.506017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.506302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.506575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.507233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:14.507534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.508884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.514560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 522/1047] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:14.520778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.528295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.528908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.529187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.529456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.530145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:14.530913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.532342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.545874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 526/1048] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:14.551783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.608518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:14.629075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0738-cba3-4045-9ec6-548794e277d3 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.655849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d367b-6b4e-44fc-8a46-892f4119ac09 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.664413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.665024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.665517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.665625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.666240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] RBAC: Adding query filter params (type=image) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:14.666544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.667292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:14.667968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.673212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 523/1049] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:14.679437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:14.693498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.694038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.694319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.694594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.695341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] RBAC: Adding query filter params (role.id=79d43487162d41e492fce09a105c7f2c, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=1b3bee55e837447180812b0f2bb2abd7) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:14.695650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.697724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5deb2b-d543-45b5-9575-e9ab907f1d21 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.710640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 527/1050] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:14 2022] GET /identity/v3/role_assignments?user.id=1b3bee55e837447180812b0f2bb2abd7&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79d43487162d41e492fce09a105c7f2c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:14.760516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476102e-4b92-4f90-a601-1ef5b5368308 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.760832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476102e-4b92-4f90-a601-1ef5b5368308 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.761065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476102e-4b92-4f90-a601-1ef5b5368308 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.762560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 528/1051] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:38:14.768103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.768415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.768657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.788745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:14.790034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:14.800069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9ad5-3289-48c1-9865-b264e5e86ab2 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:14.843886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:14.844501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:14.844782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:14.845051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:14.845710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:14.847113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:14.875167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 524/1052] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:38:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:38:14.890894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 529/1053] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:38:15.158776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:15.161700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:15.263868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8699e-94eb-4296-98d6-ce0f3bc56a9c None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:15.298039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:15.298698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:15.298976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:15.299252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:15.311311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:15.316053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:15.316958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:15.317803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 525/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:15.325059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:15.428001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:15.432222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58470f06-6efd-4c34-9f64-322bb0425c0f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:15.467994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:15.468599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:15.468878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:15.469155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:15.469817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:15.470120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:15.471518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:15.479904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 530/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:15.485677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:15.548147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:15.587874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b9fd-991e-43e7-b46b-e8ca973e9107 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:15.620835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:15.621449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:15.621725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:15.621997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] PATH_INFO: `/v3/users/ab2bbae2bd37462192884610793e0451` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:15.634724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2bbae2bd37462192884610793e0451)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:15.636204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:15.637995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 526/1056] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:15 2022] GET /identity/v3/users/ab2bbae2bd37462192884610793e0451 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:15.643658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:15.742227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6d37-de85-4d83-a34e-8ec2f8b0d4cc None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:15.774184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:15.775332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:15.775619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:15.775890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:15.805243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:15.845503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:15.846980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:15.954696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 531/1057] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:38:15.956761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:16.057800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff08c45-60f1-4530-9981-64f2e4e60ef5 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:16.077304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:16.092592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1edd-cc66-4046-a48f-cd0e3571e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:16.093211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1edd-cc66-4046-a48f-cd0e3571e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:16.102265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1edd-cc66-4046-a48f-cd0e3571e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:16.102265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1edd-cc66-4046-a48f-cd0e3571e2d8 None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:16.103868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae1edd-cc66-4046-a48f-cd0e3571e2d8 None admin] RBAC: Authorizing `identity:get_project(project_id=be02470e6cc042bc893d3c62dd69b0df)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:16.105376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae1edd-cc66-4046-a48f-cd0e3571e2d8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:16.112027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 527/1058] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:15 2022] GET /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:16.113570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:16.171226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:16.212711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef91b7-f979-46ce-9972-38b3f147cae2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:16.246209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:16.246867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:16.247148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:16.247416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:16.248139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=be02470e6cc042bc893d3c62dd69b0df, user.id=ab2bbae2bd37462192884610793e0451) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:16.248443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:16.249866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795179d0-f1b1-4c3a-9398-642568b8adbc None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:16.262702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 532/1059] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:16 2022] GET /identity/v3/role_assignments?user.id=ab2bbae2bd37462192884610793e0451&scope.project.id=be02470e6cc042bc893d3c62dd69b0df&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:16.641102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c41e82-9ce7-4721-97c2-d1688cd66f50 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:16.641655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c41e82-9ce7-4721-97c2-d1688cd66f50 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:16.641655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c41e82-9ce7-4721-97c2-d1688cd66f50 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:16.643186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 528/1060] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:16.648037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b49e3-c50a-4ac6-a1be-25b37e360ae3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:16.648331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b49e3-c50a-4ac6-a1be-25b37e360ae3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:16.648606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b49e3-c50a-4ac6-a1be-25b37e360ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:16.667081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e79b49e3-c50a-4ac6-a1be-25b37e360ae3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:16.668267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e79b49e3-c50a-4ac6-a1be-25b37e360ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:16.741095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 533/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:16.815849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507cce3-2afb-4808-8090-fc5175ebf7ce None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:16.816135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507cce3-2afb-4808-8090-fc5175ebf7ce None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:16.816605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507cce3-2afb-4808-8090-fc5175ebf7ce None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:16.817952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 529/1062] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:16.823343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:16.823631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:16.823907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:16.842316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:16.843520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:16.899450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:16.919879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 534/1063] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:17.012130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507cce3-2afb-4808-8090-fc5175ebf7ce None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.113687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507cce3-2afb-4808-8090-fc5175ebf7ce None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.146084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.146730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.147013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.147284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.157790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:17.162360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:17.163322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:17.164198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 530/1064] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:17.171528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.188607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.241598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:17.286968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa54c2-44b6-4227-a854-4158ed0c227d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.297909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e77eb-64aa-4340-9810-e52c6de72767 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.324116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.324734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.325008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.325285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.325950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:17.326256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.327677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.336180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 535/1065] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:17.341351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.345992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.346818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.347277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.347703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.389125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:17.425160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.426529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.444399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d5087-2dd1-47ac-a172-de83f89c36d9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.479832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:17.483110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.483753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.484568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.484568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.496028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.497526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:17.514256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:17.515685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:17.516982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:17.516982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:17.516982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:17.516982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 536/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:17.521972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.537946 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 531/1067] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:38:17.544024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.625024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:17.630100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410b413-7b0b-40b8-b164-97188740656f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.652850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00879-23fd-4d13-aa1c-f27038d0773a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.668329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.668939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.669250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.669529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.670154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:17.670456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.671900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.690501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 537/1068] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:17.691462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.693792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.694425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.694733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.695011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.707157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.708761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.719030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:17.727878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:17.729072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:17.730779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:17.730779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:17.730779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:17.734157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 532/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:17.735634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.808576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e2687-d8b9-41ab-ad91-333c0151a29d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.844178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cef23-4327-4c9e-adfb-ebd3708c31ba None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:17.844979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.845800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.846243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.846704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.854853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.859542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:38:17.872132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:17.873137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:38:17.874180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:17.878166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 538/1070] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:17.878915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:17.888499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:17.889108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:17.889387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:17.889657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:17.890319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:17.890647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:17.891997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:17.899766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:17.905555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 533/1071] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:17.990979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1b7ff-fcbd-4585-a31d-578d3f2b98d7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.032471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.033105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.033386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.033662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.034419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:18.034765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.036225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725abde0-7b80-420d-9e6d-3dba6e35617d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.056911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 539/1072] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:38:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:18.062386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.113823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab059045-99a2-4401-b93f-64c7723c3c8d None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.114107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab059045-99a2-4401-b93f-64c7723c3c8d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.114374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab059045-99a2-4401-b93f-64c7723c3c8d None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.115902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 540/1073] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:18.120901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.121190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.121461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.126660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:18.141030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:18.142542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:18.173756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecb5da-a9ee-478d-bde7-ec64c6a28920 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.210951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.211581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.211859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.212202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.220854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 541/1074] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:38:18.223126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.224033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:18.238093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:18.239246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:18.240889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:18.240889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:18.240889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:18.240889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 534/1075] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:18.245007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.253090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:18.339844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0c8be-d7ba-4917-81ea-b6f8fc95e518 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.372865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.373478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.373763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.374037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.374715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:18.375025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.376414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.389279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 542/1076] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:18.394990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.483631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.492410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17638d7-2e9d-41f6-9ae0-5c3523d77068 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.505881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:18.527855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.528475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.528752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.529029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.535604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.537010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:38:18.547669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:18.548702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:18.549607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 535/1077] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:18.550105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:18.554671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.587126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abaf2a-faeb-42dd-b1d0-9d7a5834b871 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.620141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.620778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.621133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.621531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.632279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:18.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:18.638580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:18.639460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 543/1078] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:18.644458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.652280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed431eb9-7c3d-4a5a-8b64-a21bf984c5bb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.685639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.686249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.686507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.686811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.687493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:18.687804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.689217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.701007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 536/1079] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:18.706865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.736252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:18.740903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693839a-90c3-498e-8f05-4c0b3ecf6b44 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.766412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:18.775596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.776288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.776569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.776839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.777495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:18.777797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.779199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.787450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 544/1080] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:18.793068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:18.807606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527faf-6b92-41eb-8833-265556a24b98 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.841531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.842178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.842458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.842777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/1b3bee55e837447180812b0f2bb2abd7/roles/79d43487162d41e492fce09a105c7f2c` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.844913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=1b3bee55e837447180812b0f2bb2abd7, role_id=79d43487162d41e492fce09a105c7f2c)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.846323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.861608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 537/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:38:18 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/1b3bee55e837447180812b0f2bb2abd7/roles/79d43487162d41e492fce09a105c7f2c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:38:18.894781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922a11-200a-48f7-a487-6e11d689b27e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:18.934354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:18.935025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:18.935305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:18.935579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] PATH_INFO: `/v3/users/ab2bbae2bd37462192884610793e0451` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:18.936749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2bbae2bd37462192884610793e0451)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:18.938197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:18.939872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 545/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/users/ab2bbae2bd37462192884610793e0451 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:18.945744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:19.041613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:19.050723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078a53d-0c3f-4afe-bbf0-692e95039330 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:19.084100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502ee1-a1c8-4c71-9630-19d3f6992c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:19.084723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502ee1-a1c8-4c71-9630-19d3f6992c71 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:19.085003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502ee1-a1c8-4c71-9630-19d3f6992c71 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:19.085279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502ee1-a1c8-4c71-9630-19d3f6992c71 None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:19.086408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502ee1-a1c8-4c71-9630-19d3f6992c71 None admin] RBAC: Authorizing `identity:get_project(project_id=be02470e6cc042bc893d3c62dd69b0df)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:19.087880 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502ee1-a1c8-4c71-9630-19d3f6992c71 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:19.089503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 538/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:18 2022] GET /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:19.095416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:19.150402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:19.193053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1fb-47fa-41e1-a8b7-ff43d7e94766 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:19.226541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a08ef-25ce-4734-8a10-4a726ded020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:19.227212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a08ef-25ce-4734-8a10-4a726ded020d None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:19.227483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a08ef-25ce-4734-8a10-4a726ded020d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:19.227783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a08ef-25ce-4734-8a10-4a726ded020d None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df/users/ab2bbae2bd37462192884610793e0451/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:19.229628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a08ef-25ce-4734-8a10-4a726ded020d None admin] RBAC: Authorizing `identity:create_grant(project_id=be02470e6cc042bc893d3c62dd69b0df, user_id=ab2bbae2bd37462192884610793e0451, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:19.231082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a08ef-25ce-4734-8a10-4a726ded020d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:19.243955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 546/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:38:19 2022] PUT /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df/users/ab2bbae2bd37462192884610793e0451/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:38:20.765426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8f166-d036-4e66-b6d9-090e8b7f6734 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:20.765956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8f166-d036-4e66-b6d9-090e8b7f6734 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:20.765956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8f166-d036-4e66-b6d9-090e8b7f6734 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:20.767346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 539/1085] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:20.772583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac24a-e876-4caa-9707-d1c63665467e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:20.772974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac24a-e876-4caa-9707-d1c63665467e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:20.773206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac24a-e876-4caa-9707-d1c63665467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:20.793435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-771ac24a-e876-4caa-9707-d1c63665467e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:20.794667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-771ac24a-e876-4caa-9707-d1c63665467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:20.861781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 547/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:21.116045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc62a-0d07-4c45-9f32-558cf71ac3cc None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.116330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc62a-0d07-4c45-9f32-558cf71ac3cc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.116609 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc62a-0d07-4c45-9f32-558cf71ac3cc None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.117939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 540/1087] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:21.122973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.123261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.123536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.131001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc62a-0d07-4c45-9f32-558cf71ac3cc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.141569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:21.142770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:21.184974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:21.210682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 548/1088] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:21.230628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc62a-0d07-4c45-9f32-558cf71ac3cc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.263568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.264183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.264462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.264734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.274407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:21.279545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:21.280611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:21.281786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 541/1089] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:21.286481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.381619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4801c-70d6-4c54-87db-dd9eb3a9a58d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.413959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.414544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.414846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.415116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.416301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:21.416599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:21.417946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:21.425563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 549/1090] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:21.431455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.452557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:21.476801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.517286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:21.529890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c94c5-39a5-4961-a09a-24d03de1e443 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.563903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.564523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.564803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.565075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.575312 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:21.576739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:21.580358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef4444-ad20-4caf-8a80-ab14cc63dc29 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:21.590559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:21.591577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:21.592480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:21.592480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:21.592480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:21.592480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 542/1091] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:21.597655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.612773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.613397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.613672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.613943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.624929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:21.629640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:21.630732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:21.631589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 550/1092] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:21.637255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.667203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:21.697168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3c5c-9866-424c-a16b-098658006b78 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.729864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.730459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.730768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.730863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:21.731054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.731755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:21.732044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:21.733442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:21.736064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6c37b-37e0-4dd5-b13c-62f80970caf5 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.745521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 543/1093] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:21.751143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.773986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.775369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.775651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.775926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.776585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:21.776890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:21.778501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:21.787433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 551/1094] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:21.793084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.847413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407800b3-0e74-4a2c-a9b1-62a0e262d156 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.878403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:21.885253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.885875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.886153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.886423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.889645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759d03-ccd8-4f18-9b3e-45b441644685 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:21.893539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:21.895136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:38:21.907005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:21.907967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:21.908924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 544/1095] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:21.913700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.924814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:21.925440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:21.925713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:21.925986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] PATH_INFO: `/v3/users/ab2bbae2bd37462192884610793e0451` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:21.927389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2bbae2bd37462192884610793e0451)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:21.928810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:21.935189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 552/1096] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/users/ab2bbae2bd37462192884610793e0451 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:21.936625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:21.964720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.011556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c09c5-56b2-4d4b-a9dd-03cef7eb4896 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.034410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea053a-6a8c-4005-bb52-b0987d04c077 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.044338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.044943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.045222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.045494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.046211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:22.046515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.047964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.065627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 545/1097] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:22.071207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.072780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.073386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.073661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.073931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.122572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.146414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.147852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.173361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cb63c-0794-468b-ac40-cfa0152ac408 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.173593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.207365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.207959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.208236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.208504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.244170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 553/1098] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:38:22.249940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.273578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.275541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.321235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.345007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25425a00-d27f-4f9c-bf57-a19df45385c8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.371066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.371429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 546/1099] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:38:22.377111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.382406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.383057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.383332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.383603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.384724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] RBAC: Authorizing `identity:get_project(project_id=be02470e6cc042bc893d3c62dd69b0df)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.386265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.387893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 554/1100] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:22.393600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.483808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbce08-6f9a-4856-bf60-f8902d60b54e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.499181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29687d-c16e-4f86-9ebf-1969d7e40ddb None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.516930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.517548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.517829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.518104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.528487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.529913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.532594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.533185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.533460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.533728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.534440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=be02470e6cc042bc893d3c62dd69b0df, user.id=ab2bbae2bd37462192884610793e0451) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:22.534777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.536174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.541824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 555/1101] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/role_assignments?user.id=ab2bbae2bd37462192884610793e0451&scope.project.id=be02470e6cc042bc893d3c62dd69b0df&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:22.543973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:22.545177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:38:22.546275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:22.546275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:38:22.546275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:22.549749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 547/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:38:22.550998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.614029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.657080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14cc5-d250-40eb-9458-37f16caecd3e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.692807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.693417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.693688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.693955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.694595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:22.694926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.696282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.708028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 556/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:22.713936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.716881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:22.817201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ba164-d83b-4f8d-8e90-dbf18eb53260 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.849401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:22.850012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:22.850288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:22.850559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:22.859392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:22.859392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:38:22.871196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:22.872203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:22.873107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 548/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:22.878129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:22.976420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f32e-6eee-4cf5-b966-bd8ba1c40a52 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:22.996784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:23.011424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:23.012034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:23.012307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:23.012576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:23.013256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:23.013560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:23.015011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf625-ef56-487c-983d-b59085d63242 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:23.026285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 557/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:23.032375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:23.092239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:23.131685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a60f1-fa51-4ab7-a6f3-4d095689266f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:23.164479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:23.165072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:23.165871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:23.166144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:23.166901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] RBAC: Adding query filter params (role.id=79d43487162d41e492fce09a105c7f2c, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=1b3bee55e837447180812b0f2bb2abd7) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:23.167209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:23.168621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baba86-32da-4553-9f2d-281cd2e3b4f5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:23.174293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 549/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:23 2022] GET /identity/v3/role_assignments?user.id=1b3bee55e837447180812b0f2bb2abd7&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79d43487162d41e492fce09a105c7f2c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:24.449188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d9001-60d8-4992-9584-a155aa79ab70 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:24.449746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d9001-60d8-4992-9584-a155aa79ab70 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:24.449746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d9001-60d8-4992-9584-a155aa79ab70 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:24.451104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 558/1107] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:24.456133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:24.456503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:24.456686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:24.474547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:24.475750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:24.539253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 550/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:24.804727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d9001-60d8-4992-9584-a155aa79ab70 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:24.904588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d9001-60d8-4992-9584-a155aa79ab70 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:24.937950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f56d3-3517-476e-afbb-f3b4621b6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:24.938568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f56d3-3517-476e-afbb-f3b4621b6be8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:24.938880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f56d3-3517-476e-afbb-f3b4621b6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:24.939155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f56d3-3517-476e-afbb-f3b4621b6be8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:24.940263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f56d3-3517-476e-afbb-f3b4621b6be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:24.941692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f56d3-3517-476e-afbb-f3b4621b6be8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:24.943278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 559/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:24.952382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:25.006578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:25.048584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7634c-2a05-4b8a-a13a-d1edad5c7afd None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:25.081500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb30f1-afa5-41a3-b316-3da2b1946c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:25.082035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb30f1-afa5-41a3-b316-3da2b1946c6d None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:25.082314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb30f1-afa5-41a3-b316-3da2b1946c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:25.082587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb30f1-afa5-41a3-b316-3da2b1946c6d None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:25.083253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb30f1-afa5-41a3-b316-3da2b1946c6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:25.084666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb30f1-afa5-41a3-b316-3da2b1946c6d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:25.105213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 551/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:38:24 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:27.010578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9882-325f-4e55-bd6b-4a677e00964d None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:27.011194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9882-325f-4e55-bd6b-4a677e00964d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:27.011292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9882-325f-4e55-bd6b-4a677e00964d None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:27.012644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 560/1111] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:27.017897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:27.018320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:27.018428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:27.036505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:27.037679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:27.101390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 552/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:27.372663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9882-325f-4e55-bd6b-4a677e00964d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:27.420426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:27.470213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9882-325f-4e55-bd6b-4a677e00964d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:27.501661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:27.502264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:27.502538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:27.502833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] PATH_INFO: `/v3/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:27.504185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] RBAC: Authorizing `identity:get_role(role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:27.505543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:27.506843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 561/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:27 2022] GET /identity/v3/roles/df14a02f49874f9892c73d73eac93c84 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:27.513118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:27.557987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:27.613125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdccea4-2e9f-4f9a-ba14-895060153dc2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:27.646166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:27.646771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:27.647051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:27.647322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] PATH_INFO: `/v3/users/9329d6c9bced4d8389c6a90c1ffb7727` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:27.659691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] RBAC: Authorizing `identity:get_user(user_id=9329d6c9bced4d8389c6a90c1ffb7727)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:27.661112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:27.662691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 553/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:27 2022] GET /identity/v3/users/9329d6c9bced4d8389c6a90c1ffb7727 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:27.668876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:27.763293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f0db9-58ef-4fe2-8772-f767d521b0b4 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:27.778224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:27.795706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:27.796289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:27.796569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:27.796838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:27.860924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:27.862356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:27.957362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 562/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:38:27.963969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:28.056654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:28.059551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3791e-b277-46f7-9e29-339667cc06ab None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:28.091754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112babdd-11e1-49fc-9e9e-f0cd709d690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:28.092364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112babdd-11e1-49fc-9e9e-f0cd709d690d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:28.092640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112babdd-11e1-49fc-9e9e-f0cd709d690d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:28.092909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112babdd-11e1-49fc-9e9e-f0cd709d690d None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:28.093989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112babdd-11e1-49fc-9e9e-f0cd709d690d None admin] RBAC: Authorizing `identity:get_project(project_id=be02470e6cc042bc893d3c62dd69b0df)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:28.095536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112babdd-11e1-49fc-9e9e-f0cd709d690d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:28.097120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 554/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:27 2022] GET /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:28.103323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:28.120418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:28.198888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4160c01-7851-4e14-8bfb-ed8afec6cc1b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:28.230585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:28.231149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:28.231427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:28.231697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:28.232410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] RBAC: Adding query filter params (role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=be02470e6cc042bc893d3c62dd69b0df, user.id=9329d6c9bced4d8389c6a90c1ffb7727) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:28.232715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:28.234162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63a016-02d3-476b-86b9-c98b0a6e6656 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:28.239306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 563/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:28 2022] GET /identity/v3/role_assignments?user.id=9329d6c9bced4d8389c6a90c1ffb7727&scope.project.id=be02470e6cc042bc893d3c62dd69b0df&role.id=df14a02f49874f9892c73d73eac93c84 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:30.078126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff5e4-8500-4463-a8be-ee2043fbe3a1 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:30.078689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff5e4-8500-4463-a8be-ee2043fbe3a1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:30.078689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff5e4-8500-4463-a8be-ee2043fbe3a1 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:30.080033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 555/1118] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:30.085018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:30.085418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:30.085564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:30.103968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:30.105124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:30.169091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 564/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:30.449988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff5e4-8500-4463-a8be-ee2043fbe3a1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:30.549957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff5e4-8500-4463-a8be-ee2043fbe3a1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:30.582372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:30.583017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:30.583299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:30.583571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] PATH_INFO: `/v3/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:30.584944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] RBAC: Authorizing `identity:get_role(role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:30.586296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:30.588178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 556/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:30 2022] GET /identity/v3/roles/df14a02f49874f9892c73d73eac93c84 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:30.594105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:30.605788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:30.688286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c100633-2615-40a8-94ed-2b1cf4f34a8b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:30.720879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:30.721441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:30.721717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:30.721984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] PATH_INFO: `/v3/users/9329d6c9bced4d8389c6a90c1ffb7727` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:30.723090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] RBAC: Authorizing `identity:get_user(user_id=9329d6c9bced4d8389c6a90c1ffb7727)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:30.724503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:30.726015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 565/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:30 2022] GET /identity/v3/users/9329d6c9bced4d8389c6a90c1ffb7727 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:30.731603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:30.765715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:30.828280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821049ec-afd9-49d3-aa93-6748e0babf59 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:30.860232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccb83-f227-4894-a72f-b924233ca935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:30.860852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccb83-f227-4894-a72f-b924233ca935 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:30.861132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccb83-f227-4894-a72f-b924233ca935 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:30.861405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccb83-f227-4894-a72f-b924233ca935 None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:30.862504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccb83-f227-4894-a72f-b924233ca935 None admin] RBAC: Authorizing `identity:get_project(project_id=be02470e6cc042bc893d3c62dd69b0df)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:30.863945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccb83-f227-4894-a72f-b924233ca935 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:30.865554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 557/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:30 2022] GET /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:30.871584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:30.945931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:30.969918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8cfe3-99fb-4475-b0b6-b70fb16980a1 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:31.003190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab733625-97bd-4c05-bd0f-3c8d7d5ae351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:31.003779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab733625-97bd-4c05-bd0f-3c8d7d5ae351 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:31.004059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab733625-97bd-4c05-bd0f-3c8d7d5ae351 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:31.004356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab733625-97bd-4c05-bd0f-3c8d7d5ae351 None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df/users/9329d6c9bced4d8389c6a90c1ffb7727/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:31.006445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab733625-97bd-4c05-bd0f-3c8d7d5ae351 None admin] RBAC: Authorizing `identity:create_grant(project_id=be02470e6cc042bc893d3c62dd69b0df, user_id=9329d6c9bced4d8389c6a90c1ffb7727, role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:31.007909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab733625-97bd-4c05-bd0f-3c8d7d5ae351 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:31.019821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 566/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:38:30 2022] PUT /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df/users/9329d6c9bced4d8389c6a90c1ffb7727/roles/df14a02f49874f9892c73d73eac93c84 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:38:32.890288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39f79-6c69-45d8-b879-747e467516cd None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:32.890703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39f79-6c69-45d8-b879-747e467516cd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:32.890960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39f79-6c69-45d8-b879-747e467516cd None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:32.892314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 558/1124] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:32.897381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:32.897819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:32.897922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:32.915790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:32.916958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:32.981943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 567/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:33.246143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39f79-6c69-45d8-b879-747e467516cd None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:33.345651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39f79-6c69-45d8-b879-747e467516cd None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:33.347911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:33.378833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:33.379449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:33.379733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:33.380010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] PATH_INFO: `/v3/roles/df14a02f49874f9892c73d73eac93c84` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:33.381399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] RBAC: Authorizing `identity:get_role(role_id=df14a02f49874f9892c73d73eac93c84)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:33.382896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:33.384726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 559/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:33 2022] GET /identity/v3/roles/df14a02f49874f9892c73d73eac93c84 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:33.390395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:33.463107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:33.495685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70daa0-137c-42b8-9707-7360fb71b306 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:33.527953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:33.528521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:33.528798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:33.529069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] PATH_INFO: `/v3/users/9329d6c9bced4d8389c6a90c1ffb7727` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:33.530169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] RBAC: Authorizing `identity:get_user(user_id=9329d6c9bced4d8389c6a90c1ffb7727)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:33.531622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:33.533186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 568/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:33 2022] GET /identity/v3/users/9329d6c9bced4d8389c6a90c1ffb7727 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:33.539000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:33.633611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26616-2218-4b74-8a24-95e7d8126e69 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:33.665910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:33.666522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:33.666811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:33.667083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:33.706205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:33.731890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:33.733326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:33.829935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 560/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:38:33.835823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:33.931549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1891-9fb7-4d8d-acaf-7846a247f728 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:33.964315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a39a5-d159-469c-aed7-b7d9e736706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:33.964922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a39a5-d159-469c-aed7-b7d9e736706c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:33.965200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a39a5-d159-469c-aed7-b7d9e736706c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:33.965470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a39a5-d159-469c-aed7-b7d9e736706c None admin] PATH_INFO: `/v3/projects/be02470e6cc042bc893d3c62dd69b0df` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:33.966571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a39a5-d159-469c-aed7-b7d9e736706c None admin] RBAC: Authorizing `identity:get_project(project_id=be02470e6cc042bc893d3c62dd69b0df)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:33.968024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a39a5-d159-469c-aed7-b7d9e736706c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:33.969609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 569/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:33 2022] GET /identity/v3/projects/be02470e6cc042bc893d3c62dd69b0df => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:33.975669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:34.042448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:34.070806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7a84-5058-4186-97b2-12ac74edb42b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:34.102810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:34.103338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:34.103613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:34.103881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:34.104587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] RBAC: Adding query filter params (role.id=df14a02f49874f9892c73d73eac93c84, scope.project.id=be02470e6cc042bc893d3c62dd69b0df, user.id=9329d6c9bced4d8389c6a90c1ffb7727) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:34.104892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:34.106284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48211-c4f8-44c2-ba42-b3e916fe00b1 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:34.111858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 561/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:33 2022] GET /identity/v3/role_assignments?user.id=9329d6c9bced4d8389c6a90c1ffb7727&scope.project.id=be02470e6cc042bc893d3c62dd69b0df&role.id=df14a02f49874f9892c73d73eac93c84 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:35.989900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357def9-dd68-4e74-9565-922a856e29ad None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:35.990425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357def9-dd68-4e74-9565-922a856e29ad None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:35.990425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357def9-dd68-4e74-9565-922a856e29ad None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:35.991794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 570/1131] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:35.997303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:35.997707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:35.997850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:36.015351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:36.016516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:36.079187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 562/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:36.347854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357def9-dd68-4e74-9565-922a856e29ad None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:36.351690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:36.446192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357def9-dd68-4e74-9565-922a856e29ad None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:36.479209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee71e0-6126-4942-8f3b-09c94a55dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:36.479828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee71e0-6126-4942-8f3b-09c94a55dbcb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:36.480105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee71e0-6126-4942-8f3b-09c94a55dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:36.480378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee71e0-6126-4942-8f3b-09c94a55dbcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:36.481469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee71e0-6126-4942-8f3b-09c94a55dbcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:36.482934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee71e0-6126-4942-8f3b-09c94a55dbcb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:36.484477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 571/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:36.490271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:36.553031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:36.585433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aae638-ff2a-4a1c-ba47-875add8239bd None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:36.618084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066277a-9627-4c1c-884d-67a2d04507ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:36.618665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066277a-9627-4c1c-884d-67a2d04507ea None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:36.618949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066277a-9627-4c1c-884d-67a2d04507ea None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:36.619220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066277a-9627-4c1c-884d-67a2d04507ea None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:36.619846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066277a-9627-4c1c-884d-67a2d04507ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:36.621249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066277a-9627-4c1c-884d-67a2d04507ea None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:36.645448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 563/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:38:36 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:38.563641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c59c0-319c-4b3a-9999-fd922c19ca57 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:38.564171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c59c0-319c-4b3a-9999-fd922c19ca57 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:38.564171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c59c0-319c-4b3a-9999-fd922c19ca57 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:38.565532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 572/1135] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:38.570780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791a486-718f-4894-939b-759ae660aa37 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:38.571226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791a486-718f-4894-939b-759ae660aa37 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:38.571893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791a486-718f-4894-939b-759ae660aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:38.589718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-6791a486-718f-4894-939b-759ae660aa37 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:38.590930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6791a486-718f-4894-939b-759ae660aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:38.654854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 564/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:38.921433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c59c0-319c-4b3a-9999-fd922c19ca57 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:38.992868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:39.021893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c59c0-319c-4b3a-9999-fd922c19ca57 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:39.054388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47815b-0217-4a13-bbc0-b100ffa9fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:39.055024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47815b-0217-4a13-bbc0-b100ffa9fe83 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:39.055300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47815b-0217-4a13-bbc0-b100ffa9fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:39.056150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47815b-0217-4a13-bbc0-b100ffa9fe83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:39.057243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47815b-0217-4a13-bbc0-b100ffa9fe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:39.058682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47815b-0217-4a13-bbc0-b100ffa9fe83 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:39.060239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 573/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:39.065948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791a486-718f-4894-939b-759ae660aa37 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:39.111871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:39.160506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791a486-718f-4894-939b-759ae660aa37 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:39.201123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba37f9-40bf-4226-aef1-0fd6a5ed7932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:39.201728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba37f9-40bf-4226-aef1-0fd6a5ed7932 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:39.202011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba37f9-40bf-4226-aef1-0fd6a5ed7932 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:39.202286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba37f9-40bf-4226-aef1-0fd6a5ed7932 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:39.202954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba37f9-40bf-4226-aef1-0fd6a5ed7932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:39.204374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba37f9-40bf-4226-aef1-0fd6a5ed7932 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:39.224459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 565/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:38:39 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:41.130774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacebf9-641d-4148-9ac4-5467602ca474 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:41.131291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacebf9-641d-4148-9ac4-5467602ca474 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:41.131291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacebf9-641d-4148-9ac4-5467602ca474 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:41.132568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 574/1139] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:41.137851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:41.138261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:41.138400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:41.157199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:41.158363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:41.221937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 566/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:41.491355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacebf9-641d-4148-9ac4-5467602ca474 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:41.590799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacebf9-641d-4148-9ac4-5467602ca474 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:41.622876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:41.623484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:41.623764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:41.624038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:41.631266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:41.634828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:41.639791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:41.640938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:41.642022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 575/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:41.646923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:41.679780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:41.744254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c169-dec5-49a9-8eb9-15841639fd3f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:41.776311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:41.776910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:41.777191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:41.777464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:41.778117 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:41.778419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:41.779806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:41.787523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 567/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:41.793115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:41.889738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc1067-dcd4-4e9a-8713-bb66b3e08742 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:41.922956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:41.923568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:41.923844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:41.924116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] PATH_INFO: `/v3/users/a34760ceb9a4494ba79745951addeb4e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:41.937395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] RBAC: Authorizing `identity:get_user(user_id=a34760ceb9a4494ba79745951addeb4e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:41.938863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:41.940416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 576/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:41 2022] GET /identity/v3/users/a34760ceb9a4494ba79745951addeb4e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:41.946235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:42.036103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:42.041923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a06263-9ce0-4344-ac8e-9adf2fa4eb32 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:42.075081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:42.075675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:42.075952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:42.076288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:42.141087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:42.142509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:42.232716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:42.239283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 568/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:38:42.245903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:42.303718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:42.343978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fb08-405d-4780-a3da-4516679397bd None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:42.376909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d273-85e9-4fcb-b591-abb34acd9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:42.377525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d273-85e9-4fcb-b591-abb34acd9142 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:42.377799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d273-85e9-4fcb-b591-abb34acd9142 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:42.378067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d273-85e9-4fcb-b591-abb34acd9142 None admin] PATH_INFO: `/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:42.379177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d273-85e9-4fcb-b591-abb34acd9142 None admin] RBAC: Authorizing `identity:get_project(project_id=adf2c40ddc1b4b758288200e4f79cf8d)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:42.380700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d273-85e9-4fcb-b591-abb34acd9142 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:42.382489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 577/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:42 2022] GET /identity/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:42.388721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:42.485999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8acb9b-4633-474c-9de5-0890a35aa01d None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:42.517939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:42.518527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:42.518830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:42.519103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:42.519809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=adf2c40ddc1b4b758288200e4f79cf8d, user.id=a34760ceb9a4494ba79745951addeb4e) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:42.520112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:42.521507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c31b1-a128-400d-8354-d96190fae926 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:42.527217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 569/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:42 2022] GET /identity/v3/role_assignments?user.id=a34760ceb9a4494ba79745951addeb4e&scope.project.id=adf2c40ddc1b4b758288200e4f79cf8d&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:44.372833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca445-d4e6-4a72-8ee1-87dce266e220 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:44.373350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca445-d4e6-4a72-8ee1-87dce266e220 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:44.373463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca445-d4e6-4a72-8ee1-87dce266e220 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:44.374738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 578/1147] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:44.379841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:44.380230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:44.380403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:44.398507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:44.400329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:44.454049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:44.465945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 570/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:44.734357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca445-d4e6-4a72-8ee1-87dce266e220 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:44.830485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca445-d4e6-4a72-8ee1-87dce266e220 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:44.854291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:44.865297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:44.865910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:44.866189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:44.866460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:44.877388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:44.882074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:44.883169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:44.884978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 579/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:44.889794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:44.983969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d6736-1b2e-49d5-b23b-9377dc5e8cd4 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:45.017983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:45.018526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:45.018835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:45.019113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:45.019773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:45.020078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:45.021579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:45.029541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 571/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:45.035259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:45.130474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a587-9d0b-43d4-a0f6-0f8fa574f29a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:45.162016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:45.162635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:45.162917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:45.163187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] PATH_INFO: `/v3/users/a34760ceb9a4494ba79745951addeb4e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:45.164275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] RBAC: Authorizing `identity:get_user(user_id=a34760ceb9a4494ba79745951addeb4e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:45.166210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:45.167749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 580/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:45 2022] GET /identity/v3/users/a34760ceb9a4494ba79745951addeb4e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:45.173169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:45.224229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:45.270067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f719-b527-42f0-84da-b516486eb814 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:45.303628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc4d1-b1d0-4811-a3c2-04f8bd905999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:45.304241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc4d1-b1d0-4811-a3c2-04f8bd905999 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:45.304516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc4d1-b1d0-4811-a3c2-04f8bd905999 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:45.304783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc4d1-b1d0-4811-a3c2-04f8bd905999 None admin] PATH_INFO: `/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:45.306388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc4d1-b1d0-4811-a3c2-04f8bd905999 None admin] RBAC: Authorizing `identity:get_project(project_id=adf2c40ddc1b4b758288200e4f79cf8d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:45.307830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc4d1-b1d0-4811-a3c2-04f8bd905999 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:45.309421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 572/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:45 2022] GET /identity/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:45.315449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:45.368871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:45.412023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611ece-03a7-464c-8c80-df4d535ff232 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:45.444634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36e12-d2e1-44b8-b108-2a0c87e0c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:45.445268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36e12-d2e1-44b8-b108-2a0c87e0c140 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:45.445543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36e12-d2e1-44b8-b108-2a0c87e0c140 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:45.445811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36e12-d2e1-44b8-b108-2a0c87e0c140 None admin] PATH_INFO: `/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d/users/a34760ceb9a4494ba79745951addeb4e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:45.448261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36e12-d2e1-44b8-b108-2a0c87e0c140 None admin] RBAC: Authorizing `identity:create_grant(project_id=adf2c40ddc1b4b758288200e4f79cf8d, user_id=a34760ceb9a4494ba79745951addeb4e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:45.449672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36e12-d2e1-44b8-b108-2a0c87e0c140 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:45.461705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 581/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:38:45 2022] PUT /identity/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d/users/a34760ceb9a4494ba79745951addeb4e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:38:47.337887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0e50-9cf6-4cfe-935a-b2082f222df6 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:47.338435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0e50-9cf6-4cfe-935a-b2082f222df6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:47.338435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0e50-9cf6-4cfe-935a-b2082f222df6 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:47.339788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 573/1154] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:47.344982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:47.345353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:47.345532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:47.363454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:47.364628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:47.428718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 582/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:47.691981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0e50-9cf6-4cfe-935a-b2082f222df6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:47.788898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0e50-9cf6-4cfe-935a-b2082f222df6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:47.808141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:47.821840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:47.822448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:47.822751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:47.823020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:47.832516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:38:47.837140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:47.838259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:38:47.839174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 574/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:47.844335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:47.888159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:47.940256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8e4d-a770-458d-8b40-53a34f75cdde None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:47.971765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:47.972296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:47.972569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:47.972837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:47.973489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:47.973787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:47.975171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:47.983266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 583/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:47.989098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:48.083877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3040ae-8e2c-4554-8bf6-ae244bcea4a7 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:48.115881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:48.116488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:48.116771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:48.117046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] PATH_INFO: `/v3/users/a34760ceb9a4494ba79745951addeb4e` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:48.118753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] RBAC: Authorizing `identity:get_user(user_id=a34760ceb9a4494ba79745951addeb4e)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:48.120154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:48.121686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 575/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:38:47 2022] GET /identity/v3/users/a34760ceb9a4494ba79745951addeb4e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:48.127298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:48.222951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d996a7c-946d-45bd-ab5b-3ac761049d5b None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:48.229437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:48.255320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:48.255905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:48.256178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:48.256446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:48.320320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:48.322311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:48.415836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 584/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:38:48.421745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:48.468701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:48.519331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f406df-8db6-4730-a805-8965b759dd3e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:48.554490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcbffe-bdeb-4bd5-be24-15ecdec2b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:48.555207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcbffe-bdeb-4bd5-be24-15ecdec2b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:48.555488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcbffe-bdeb-4bd5-be24-15ecdec2b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:48.555761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcbffe-bdeb-4bd5-be24-15ecdec2b1c4 None admin] PATH_INFO: `/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:48.556857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcbffe-bdeb-4bd5-be24-15ecdec2b1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=adf2c40ddc1b4b758288200e4f79cf8d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:48.558279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcbffe-bdeb-4bd5-be24-15ecdec2b1c4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:48.559958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 576/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:38:48 2022] GET /identity/v3/projects/adf2c40ddc1b4b758288200e4f79cf8d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:48.566026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:48.573873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:48.661106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62db2-91d1-4e84-8a55-49a6ea07c8da None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:48.694105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:48.694725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:48.695003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:48.695274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:48.696003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=adf2c40ddc1b4b758288200e4f79cf8d, user.id=a34760ceb9a4494ba79745951addeb4e) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:48.696805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:48.698222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f325-3be8-41c3-a2e1-5b6f124d5b5c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:48.703722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 585/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:38:48 2022] GET /identity/v3/role_assignments?user.id=a34760ceb9a4494ba79745951addeb4e&scope.project.id=adf2c40ddc1b4b758288200e4f79cf8d&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:38:50.586350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f00c-023d-45c5-834e-855f62051114 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:50.586910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f00c-023d-45c5-834e-855f62051114 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:50.586910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f00c-023d-45c5-834e-855f62051114 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:50.588263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 577/1162] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:50.593446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:50.593852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:50.593999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:50.611413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:50.612587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:50.672286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:50.677528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 586/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:50.944630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f00c-023d-45c5-834e-855f62051114 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:51.043273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f00c-023d-45c5-834e-855f62051114 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:51.060418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:51.078504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:51.079130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:51.079413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:51.079690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:51.143947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:51.145320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:51.238373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 578/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:38:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:38:51.244781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:51.338538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e854f68-5800-489c-b221-47b4b18d9547 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:51.370540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:51.371179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:51.371454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:51.371724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:51.378009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:51.379447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-7ea00d68-714d-4fcc-90b7-7bcf9f40dc04 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:38:51.390405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:38:51.391676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:38:51.392724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 587/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:38:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:38:51.397337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:51.414514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:51.492741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739009f-17ee-4b09-8ede-1c6c4bc498d6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:51.524062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:51.525154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:51.525429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:51.525697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:51.526319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:38:51.526642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:51.527974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76da62-a604-4ef7-b7ab-1a350585a006 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:51.534765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 579/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 12 11:38:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:53.430466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b76269-b523-4cb4-a55d-98c50836ffef None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:53.431023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b76269-b523-4cb4-a55d-98c50836ffef None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:53.431023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b76269-b523-4cb4-a55d-98c50836ffef None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:53.432356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 588/1167] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:53.437538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4f651-4b56-4936-89d2-b4d63d40f61c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:53.437932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4f651-4b56-4936-89d2-b4d63d40f61c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:53.438086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4f651-4b56-4936-89d2-b4d63d40f61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:53.455870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2fc4f651-4b56-4936-89d2-b4d63d40f61c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:53.457031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2fc4f651-4b56-4936-89d2-b4d63d40f61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:53.519812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 580/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:38:53.786886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b76269-b523-4cb4-a55d-98c50836ffef None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:53.845077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:53.885658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b76269-b523-4cb4-a55d-98c50836ffef None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:53.918123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceeb976-e56a-4039-b76e-d4aa068f7bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:53.918750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceeb976-e56a-4039-b76e-d4aa068f7bf4 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:53.919026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceeb976-e56a-4039-b76e-d4aa068f7bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:53.919295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceeb976-e56a-4039-b76e-d4aa068f7bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:53.919952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceeb976-e56a-4039-b76e-d4aa068f7bf4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:53.921302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceeb976-e56a-4039-b76e-d4aa068f7bf4 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:53.936338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 589/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Aug 12 11:38:53 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:55.837214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85bef5-af46-4688-befd-769d47eec1c2 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:55.837769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85bef5-af46-4688-befd-769d47eec1c2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:55.837769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85bef5-af46-4688-befd-769d47eec1c2 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:55.839121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 581/1170] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:55.844144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:55.844559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:55.844701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:55.862410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:55.863629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:55.927244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 590/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:56.190578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85bef5-af46-4688-befd-769d47eec1c2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:56.202456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:56.286200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85bef5-af46-4688-befd-769d47eec1c2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:56.319300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0af94b-3731-4bd8-9f95-907f2a327601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:56.319903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af94b-3731-4bd8-9f95-907f2a327601 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:56.320179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af94b-3731-4bd8-9f95-907f2a327601 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:56.320449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af94b-3731-4bd8-9f95-907f2a327601 None admin] PATH_INFO: `/v3/domains/bfef138a9c6c4f30bb4cc1a92ec5d25b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:56.330205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af94b-3731-4bd8-9f95-907f2a327601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bfef138a9c6c4f30bb4cc1a92ec5d25b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:56.331652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af94b-3731-4bd8-9f95-907f2a327601 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:56.333175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 582/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Aug 12 11:38:56 2022] GET /identity/v3/domains/bfef138a9c6c4f30bb4cc1a92ec5d25b => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:56.338908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:56.386685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:56.435826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071ec0-8123-4d1d-911f-c28a873dd55c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:56.469723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231911e5-7c78-449b-8c7e-911a08aa464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:56.470255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231911e5-7c78-449b-8c7e-911a08aa464d None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:56.470528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231911e5-7c78-449b-8c7e-911a08aa464d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:56.470827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231911e5-7c78-449b-8c7e-911a08aa464d None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:56.471458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231911e5-7c78-449b-8c7e-911a08aa464d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:56.472876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231911e5-7c78-449b-8c7e-911a08aa464d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:56.498918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 591/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:38:56 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:38:58.398477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795e2ba-4fe4-4727-a795-ff9529c23514 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:58.399554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795e2ba-4fe4-4727-a795-ff9529c23514 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:58.399554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795e2ba-4fe4-4727-a795-ff9529c23514 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:58.400900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 583/1174] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:38:58.406048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:58.406511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:58.406640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:58.424640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:38:58.425812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:38:58.489519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 592/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:38:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:38:58.752645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795e2ba-4fe4-4727-a795-ff9529c23514 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:58.820144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:58.851189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795e2ba-4fe4-4727-a795-ff9529c23514 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:58.884681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35cdd-2b67-482a-81a6-1a6f2729a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:58.885301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35cdd-2b67-482a-81a6-1a6f2729a338 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:58.885582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35cdd-2b67-482a-81a6-1a6f2729a338 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:58.885855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35cdd-2b67-482a-81a6-1a6f2729a338 None admin] PATH_INFO: `/v3/domains/bfef138a9c6c4f30bb4cc1a92ec5d25b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:58.886985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35cdd-2b67-482a-81a6-1a6f2729a338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bfef138a9c6c4f30bb4cc1a92ec5d25b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:58.888390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35cdd-2b67-482a-81a6-1a6f2729a338 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:58.889940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 584/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Aug 12 11:38:58 2022] GET /identity/v3/domains/bfef138a9c6c4f30bb4cc1a92ec5d25b => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:38:58.895643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:38:58.924777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:38:58.992103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226d30-7802-4ddb-b1dc-fdcf70d43f18 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:38:59.026396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3a296-2896-40ab-a611-41029fe7008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:38:59.026963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a296-2896-40ab-a611-41029fe7008f None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:38:59.027243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a296-2896-40ab-a611-41029fe7008f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:38:59.027514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a296-2896-40ab-a611-41029fe7008f None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:38:59.028174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3a296-2896-40ab-a611-41029fe7008f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:38:59.029595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3a296-2896-40ab-a611-41029fe7008f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:38:59.051147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 593/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:38:58 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:39:00.960302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26899700-215d-4662-a65d-b35aef00be99 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:00.960848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26899700-215d-4662-a65d-b35aef00be99 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:00.960848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26899700-215d-4662-a65d-b35aef00be99 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:00.962172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 585/1178] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:39:00.967163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:00.967591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:00.967689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:00.985672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:39:00.986875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:39:01.050454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 594/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:39:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:39:01.316169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26899700-215d-4662-a65d-b35aef00be99 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:01.412543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26899700-215d-4662-a65d-b35aef00be99 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:01.444933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:01.445534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:01.445810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:01.446590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:01.453006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:01.456937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:39:01.462236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:39:01.463446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:39:01.464485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 586/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:39:01.469211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:01.486860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:01.572973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d7fd-916f-40b6-abd6-2b463e8772e0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:01.604906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:01.605501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:01.605774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:01.606041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:01.606719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:39:01.607016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:01.608361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:01.615952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 595/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:01.621863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:01.716498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526363-14af-4f06-b982-a07b32865e0e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:01.747800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:01.748402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:01.748678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:01.748947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] PATH_INFO: `/v3/users/b72effcaec8e4505a06998579c72380b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:01.761665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] RBAC: Authorizing `identity:get_user(user_id=b72effcaec8e4505a06998579c72380b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:01.763109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:01.764639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 587/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:39:01 2022] GET /identity/v3/users/b72effcaec8e4505a06998579c72380b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:01.770289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:01.849852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:01.868920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4cd7f-6d05-4ac4-a3f3-1c67d33d9c77 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:01.901406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:01.902004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:01.902281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:01.902549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:01.966205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:01.967676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:02.041797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:02.061435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 596/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:39:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:39:02.067302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:02.120626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:02.161141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5af1-d4b1-4243-be6f-b38c12d5ec53 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:02.193735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a51c-a6be-4ff9-a377-b9938f36b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:02.194340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a51c-a6be-4ff9-a377-b9938f36b9be None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:02.194638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a51c-a6be-4ff9-a377-b9938f36b9be None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:02.194915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a51c-a6be-4ff9-a377-b9938f36b9be None admin] PATH_INFO: `/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:02.196570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a51c-a6be-4ff9-a377-b9938f36b9be None admin] RBAC: Authorizing `identity:get_project(project_id=6f348f3878d048fb9b7042dcf12cc6b6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:02.197962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a51c-a6be-4ff9-a377-b9938f36b9be None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:02.199571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 588/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:39:02 2022] GET /identity/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:02.205462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:02.299719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b404a99-7a5d-458d-9f51-9bcce0f749cb None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:02.332416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:02.332998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:02.333275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:02.333545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:02.334257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=6f348f3878d048fb9b7042dcf12cc6b6, user.id=b72effcaec8e4505a06998579c72380b) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:39:02.334560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:02.335991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa7d3b-8c23-40cd-8a8a-f414ab9daf70 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:02.341702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 597/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:39:02 2022] GET /identity/v3/role_assignments?user.id=b72effcaec8e4505a06998579c72380b&scope.project.id=6f348f3878d048fb9b7042dcf12cc6b6&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:04.192063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599c8f4-2f41-4ac3-9bf0-a1941c8ce340 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:04.192575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599c8f4-2f41-4ac3-9bf0-a1941c8ce340 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:04.192575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599c8f4-2f41-4ac3-9bf0-a1941c8ce340 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:04.193894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 589/1186] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:39:04.199705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:04.200099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:04.200247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:04.218415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:39:04.219635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:39:04.257181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:04.283464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 598/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:39:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:39:04.550944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599c8f4-2f41-4ac3-9bf0-a1941c8ce340 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:04.648818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599c8f4-2f41-4ac3-9bf0-a1941c8ce340 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:04.671707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:04.682820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:04.683431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:04.683711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:04.683985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:04.693564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:39:04.698193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:39:04.699300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:39:04.700517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 590/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:39:04.705254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:04.799104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf9db7-21b0-4a1f-92b9-e3c101718e17 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:04.831050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:04.831640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:04.831916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:04.832184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:04.832834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:39:04.833140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:04.834484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:04.842589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 599/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:04.848218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:04.944011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d4e4d-3467-4061-b5a5-baf31f566a78 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:04.976035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:04.976643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:04.976923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:04.977222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] PATH_INFO: `/v3/users/b72effcaec8e4505a06998579c72380b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:04.978320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=b72effcaec8e4505a06998579c72380b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:04.979762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:04.981305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 591/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:39:04 2022] GET /identity/v3/users/b72effcaec8e4505a06998579c72380b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:04.987046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:05.021457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:05.083409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15519740-cc7a-45ba-9c25-674cd3408643 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:05.115586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae5c23-d78b-4b88-bda5-885413364890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:05.116199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c23-d78b-4b88-bda5-885413364890 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:05.116474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c23-d78b-4b88-bda5-885413364890 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:05.116744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c23-d78b-4b88-bda5-885413364890 None admin] PATH_INFO: `/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:05.118341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae5c23-d78b-4b88-bda5-885413364890 None admin] RBAC: Authorizing `identity:get_project(project_id=6f348f3878d048fb9b7042dcf12cc6b6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:05.119823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae5c23-d78b-4b88-bda5-885413364890 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:05.121413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 600/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:39:04 2022] GET /identity/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:05.127309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:05.178284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:05.223412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f8327-0b55-4e76-9e8e-55e86440d0d6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:05.256146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f433-6c61-433d-835a-e3a8165c4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:05.256780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f433-6c61-433d-835a-e3a8165c4f74 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:05.257061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f433-6c61-433d-835a-e3a8165c4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:05.257335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f433-6c61-433d-835a-e3a8165c4f74 None admin] PATH_INFO: `/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6/users/b72effcaec8e4505a06998579c72380b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:05.259250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f433-6c61-433d-835a-e3a8165c4f74 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f348f3878d048fb9b7042dcf12cc6b6, user_id=b72effcaec8e4505a06998579c72380b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:05.260645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f433-6c61-433d-835a-e3a8165c4f74 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:05.272513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 592/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:39:05 2022] PUT /identity/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6/users/b72effcaec8e4505a06998579c72380b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:39:07.147240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41467087-7f8f-4427-b9a2-bda5458624a8 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:07.147749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41467087-7f8f-4427-b9a2-bda5458624a8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:07.147749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41467087-7f8f-4427-b9a2-bda5458624a8 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:07.149057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 601/1193] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:39:07.154057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:07.154488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:07.154651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:07.172079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:39:07.173254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:39:07.236709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 593/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:39:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:39:07.504911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41467087-7f8f-4427-b9a2-bda5458624a8 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:07.609408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41467087-7f8f-4427-b9a2-bda5458624a8 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:07.611646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:07.641911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:07.642536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:07.642844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:07.643117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:07.653303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:39:07.657945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:39:07.659043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:39:07.659907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 602/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:39:07.665541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:07.706505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:07.761058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf3488-e7ce-4fe2-9a29-0002e1418a7c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:07.793787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:07.794378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:07.794680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:07.794954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:07.795607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:39:07.795910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:07.797249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:07.805185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 594/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:07.811091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:07.909995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61ea6c-a516-4858-a58c-7c13303f013d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:07.942469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:07.943237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:07.943520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:07.943796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] PATH_INFO: `/v3/users/b72effcaec8e4505a06998579c72380b` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:07.944901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=b72effcaec8e4505a06998579c72380b)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:07.946375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:07.947955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 603/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 12 11:39:07 2022] GET /identity/v3/users/b72effcaec8e4505a06998579c72380b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:07.953864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:08.049710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a962b8-4508-43b1-b2a1-8dfbe30a67c6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:08.051892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:08.082204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:08.082819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:08.083107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:08.083379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:08.146980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:08.148418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:08.243514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 595/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:39:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:39:08.249624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:08.280976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:08.348710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc2a60-f746-453b-9733-e0a5dc743bb9 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:08.380200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7fc5d-275e-4b65-9e8d-1d01e6d5e51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:08.380803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7fc5d-275e-4b65-9e8d-1d01e6d5e51a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:08.381079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7fc5d-275e-4b65-9e8d-1d01e6d5e51a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:08.381350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7fc5d-275e-4b65-9e8d-1d01e6d5e51a None admin] PATH_INFO: `/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:08.382443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7fc5d-275e-4b65-9e8d-1d01e6d5e51a None admin] RBAC: Authorizing `identity:get_project(project_id=6f348f3878d048fb9b7042dcf12cc6b6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:08.384409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7fc5d-275e-4b65-9e8d-1d01e6d5e51a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:08.385987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 604/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 12 11:39:08 2022] GET /identity/v3/projects/6f348f3878d048fb9b7042dcf12cc6b6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:08.392038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:39:08.395114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:08.486337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af00c28-d52d-4a12-878e-f2eb6d8ce9a5 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:39:08.518536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:39:08.519168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:39:08.519446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:39:08.519716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:39:08.520421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=6f348f3878d048fb9b7042dcf12cc6b6, user.id=b72effcaec8e4505a06998579c72380b) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:39:08.520722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:39:08.522115 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d4063-e223-4b0d-8a19-4c46131447db None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:39:08.528177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 596/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:39:08 2022] GET /identity/v3/role_assignments?user.id=b72effcaec8e4505a06998579c72380b&scope.project.id=6f348f3878d048fb9b7042dcf12cc6b6&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:39:18.376181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=50 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:39:18.525691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=66 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:03.416971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244e661-9a70-4b33-9be0-1e523ea36dfe None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:03.417580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244e661-9a70-4b33-9be0-1e523ea36dfe None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:03.417580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244e661-9a70-4b33-9be0-1e523ea36dfe None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:03.418869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 605/1201] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:03.424538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:03.425037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:03.425121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:03.446645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:03.448027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:03.543670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 597/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:03.835702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244e661-9a70-4b33-9be0-1e523ea36dfe None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:03.970511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244e661-9a70-4b33-9be0-1e523ea36dfe None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:04.015491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:04.016590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:04.017094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:04.017573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:04.030845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:04.032850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:04.049396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:04.057219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:04.058592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:04.058592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:04.058592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:04.058592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 606/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:04.058935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:04.191431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a66d41-42c7-47f3-bced-f3e6c113dc81 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:04.234419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:04.243398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:04.244167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:04.244475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:04.244755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:04.245460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:04.245771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:04.247381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df84658-7607-4104-b96c-4a670f5acfde None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:04.270675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 598/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:04.274954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:04.349966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:04.433637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c2cf-d74f-493e-9712-c5a454d8b625 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:04.482826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2960ef-d4ee-4ff4-be17-3e0bb9534e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:04.483722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2960ef-d4ee-4ff4-be17-3e0bb9534e7b None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:04.484202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2960ef-d4ee-4ff4-be17-3e0bb9534e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:04.484639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2960ef-d4ee-4ff4-be17-3e0bb9534e7b None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:04.485745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2960ef-d4ee-4ff4-be17-3e0bb9534e7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:04.488376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2960ef-d4ee-4ff4-be17-3e0bb9534e7b None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:04.526632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 607/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 12 11:40:04 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:40:06.624738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcecfb8-4398-4227-8a2a-7fb451c088d8 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:06.625319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcecfb8-4398-4227-8a2a-7fb451c088d8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:06.625319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcecfb8-4398-4227-8a2a-7fb451c088d8 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:06.627083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 599/1206] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:06.632266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:06.632685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:06.632842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:06.653708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:06.654931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:06.738094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 608/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:07.016852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcecfb8-4398-4227-8a2a-7fb451c088d8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:07.135446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcecfb8-4398-4227-8a2a-7fb451c088d8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:07.176933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:07.177603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:07.178011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:07.178418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:07.191582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:40:07.197216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:07.198247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:40:07.199176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:07.202994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 600/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:40:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:07.205031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:07.251279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:07.323204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d13f6d-8681-4e2d-a453-19b2ba48a598 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:07.365423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:07.366045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:07.366321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:07.366590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:07.367840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:07.368357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:07.370749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:07.380985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 609/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:40:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:07.387247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:07.448264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:07.512677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cafa7-2dc2-45d9-bd6d-bc5558807d6f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:07.557173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:07.557907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:07.558175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:07.558450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:07.575849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:07.577342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:07.596535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:07.597637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:07.598583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:07.598583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:07.598583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:07.598583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 601/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:40:07.606381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:07.728128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:07.731383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f38f0-beb8-4b30-94da-547a7f0f1fbd None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:07.773451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:07.774991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:07.775515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:07.775918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:07.776592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:07.776949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:07.778649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:07.797154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 610/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:07.798657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:07.920586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ccd4-22d8-4c6b-bd3a-6aba72a12ee6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:07.922430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:07.962087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:07.963022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:07.963459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:07.966020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:07.975690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:07.977889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:40:07.991113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:07.993023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:07.994026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 602/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:07.999732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:08.125335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bce8-8d65-47eb-a666-c30d803d816c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:08.166516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:08.167357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:08.167723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:08.170450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:08.170450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:08.170450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:08.170851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:08.193789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 611/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 12 11:40:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:08.200719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:08.324705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8783c-581b-4b63-baf0-c424937b0f1f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:08.368479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:08.369196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:08.369523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:08.369801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:08.402283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:08.447202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:08.449136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:08.582547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 603/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:40:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:40:08.588625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:08.609820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:08.712483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591b473-9dcd-464c-8b00-b90e79b01413 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:08.757875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:08.757875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:08.757875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:08.757875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:08.771532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:08.773057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:08.792884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:08.795612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:08.796723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:08.796723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:08.796723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:08.796723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 612/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:40:08.801332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:08.875713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:08.917779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de002509-f69b-4644-ba2b-00398e9c1ceb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:08.959777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:08.960374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:08.960651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:08.961469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:08.962121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:08.962488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:08.963893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:08.975715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 604/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:08.982212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:09.063475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:09.104096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f9d2-0175-46ff-9ef6-8e6859bf853e None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:09.140469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:09.141018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:09.141298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:09.141573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:09.148846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:09.150281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:40:09.161763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:09.163020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:09.163982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:09.168313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 613/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:09.169185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:09.284570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4508ee-23ab-4edf-ad20-1c9822597e22 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:09.313595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:09.327381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:09.327977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:09.328380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:09.328933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:09.329755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:09.330071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:09.331908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67fea6-2ce6-4553-a883-40f5c57e18f7 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:09.345330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 605/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:09.352823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:09.467416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e063d4-ba99-4cd9-9e1d-ee4ac2dc7288 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:09.498747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:09.505970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:09.506999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:09.507274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:09.507542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:09.508941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=3a3f00cae3d04d2fa79ed4481ce024aa) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:09.509251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:09.510884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f78e7-834c-4e27-9378-f23f178e3a71 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:09.516850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 614/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:40:09 2022] GET /identity/v3/role_assignments?user.id=3a3f00cae3d04d2fa79ed4481ce024aa&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:11.572281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1c12-2626-4851-9dc0-1c23be8d761e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:11.572811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1c12-2626-4851-9dc0-1c23be8d761e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:11.572890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1c12-2626-4851-9dc0-1c23be8d761e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:11.574619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 606/1220] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:40:11.579973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:11.580484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:11.580484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:11.601707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:11.603288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:11.689849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 615/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:11.963391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b1c12-2626-4851-9dc0-1c23be8d761e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:12.080457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b1c12-2626-4851-9dc0-1c23be8d761e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:12.115246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:12.115871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:12.116158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:12.116423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:12.126965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:40:12.131531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:12.132643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:12.133523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 607/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:12.138443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:12.241561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95f77-d6e2-4af0-84ee-8d336487f045 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:12.266891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:12.281560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:12.282525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:12.283004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:12.283440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:12.284419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] RBAC: Adding query filter params (name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:12.284922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:12.286426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:12.305822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 616/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:12.307348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:12.353195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:12.410669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f948-7eee-43b1-9963-f70044a37b97 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:12.451370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:12.452224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:12.452519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:12.452900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:12.463993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:12.465682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:12.480309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:12.481537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:12.482721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:12.482721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:12.482721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:12.482721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 608/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:12.487245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:12.600369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c04b5-2452-44fc-bece-9c1f4b9eef67 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:12.639271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:12.639892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:12.640302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:12.640609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:12.641354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:12.641715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:12.643400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:12.657992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 617/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:40:12.665517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:12.769440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:12.777095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227feb-3e29-4a7b-8227-e5afd19c077e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:12.812085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:12.812795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:12.813011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:12.813292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:12.820800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:12.822243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:40:12.833064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:12.834205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:12.835282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 609/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:12.840139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:12.893521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:12.955751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c19c-8908-48a7-939f-84475ed971a7 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:12.993401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:12.994056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:12.994331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:12.994677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:12.995402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:12.995748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:12.997281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:13.017086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 618/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 12 11:40:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:40:13.024092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:13.135812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a8cf8-3839-4db2-b810-adc341914293 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:13.174188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:13.174841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:13.175119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:13.175400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:13.186318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:13.187744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:13.202187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:13.203453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:13.204538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:13.204538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:13.204538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:13.204538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 610/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:13.209501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:13.325002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860af5-6aa1-46a2-84ac-d6193ddece69 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:13.327371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:13.372214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:13.372827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:13.373112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:13.373387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:13.374032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:13.374337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:13.375851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:13.389367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 619/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:13.396703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:13.406956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:13.510387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9253f6f-fada-4ec0-8a55-f3564c1353c6 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:13.546479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:13.547273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:13.547641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:13.547873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:13.557992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:13.560109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:40:13.577852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:13.579077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:13.580302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:13.587730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 611/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:13.587875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:13.698286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15287541-6d83-4754-8a59-70bddf5904f2 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:13.733268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:13.733844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:13.734124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:13.734396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:13.735143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:13.735547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:13.736941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dce56d-1f91-401e-b279-707d7cec1816 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:13.749235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 620/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:40:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:40:13.756381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:13.824701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:13.860021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ec00-c36a-4990-9e0c-beea82f9d349 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:13.897186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f388def-d7d0-44b0-80f5-84c7f5ff9d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:13.897884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388def-d7d0-44b0-80f5-84c7f5ff9d55 None admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:13.898816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388def-d7d0-44b0-80f5-84c7f5ff9d55 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:13.899069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388def-d7d0-44b0-80f5-84c7f5ff9d55 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/3a3f00cae3d04d2fa79ed4481ce024aa/roles/79a1959b832e471fa2b0385028524292` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:13.916129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f388def-d7d0-44b0-80f5-84c7f5ff9d55 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=3a3f00cae3d04d2fa79ed4481ce024aa, role_id=79a1959b832e471fa2b0385028524292)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:13.917604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f388def-d7d0-44b0-80f5-84c7f5ff9d55 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:13.930930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 612/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:40:13 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/3a3f00cae3d04d2fa79ed4481ce024aa/roles/79a1959b832e471fa2b0385028524292 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:40:16.099633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c971-82c1-40dc-b220-091383370bcc None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:16.100242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c971-82c1-40dc-b220-091383370bcc None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:16.100242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c971-82c1-40dc-b220-091383370bcc None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:16.101948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 621/1233] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:16.107340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:16.107806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:16.107899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:16.127157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:16.128354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:16.202782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 613/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:16.489276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379c971-82c1-40dc-b220-091383370bcc None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:16.523085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:16.609058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379c971-82c1-40dc-b220-091383370bcc None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:16.644709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:16.645381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:16.645647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:16.645963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:16.657561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:40:16.663541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:16.665462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:16.667953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 622/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 12 11:40:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:40:16.672305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:16.729290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:16.791043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23567-6b99-4f09-b1c6-164cc87fb8f0 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:16.827610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:16.828352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:16.828749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:16.829029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:16.829815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] RBAC: Adding query filter params (name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:16.830122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:16.831838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:16.841698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 614/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 12 11:40:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:16.847548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:16.939726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:16.957110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c6139-67a8-48f9-b497-8a3bd0689870 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:16.995394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:16.996177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:16.996571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:16.996852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:17.008717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:17.010311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:17.028497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:17.029831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:17.030786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:17.030786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:17.030786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:17.030786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 623/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:17.036293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:17.150098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1e5f-72cc-4923-90da-b6ae9ec31599 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:17.160101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:17.187836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:17.188632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:17.188912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:17.189186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:17.190085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:17.190465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:17.192161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:17.206482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 615/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:40:17.214124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:17.331262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592039-0464-4fd9-acac-a7decc2f7760 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:17.366536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:17.367176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:17.367457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:17.367879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:17.370976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:17.377320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:17.379221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:40:17.393078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:17.399771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:17.401259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 624/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:17.402828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:17.517158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b6c89-b8e0-452b-9e79-e91b62044e65 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:17.557906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:17.558600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:17.558957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:17.559235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:17.560022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:17.560328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:17.561845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:17.581785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 616/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 12 11:40:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:17.588036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:17.705509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1501989-faeb-4430-816d-3fe8ef73328d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:17.745379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:17.745987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:17.746262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:17.746537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:17.815891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:17.825229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:17.826704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:17.941784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 625/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:40:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:40:17.947960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:17.978936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:18.059814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1d23c-1b20-4ee3-ae70-10a01065be39 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:18.099251 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:18.100044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:18.100563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:18.101064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:18.113501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:18.115120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:18.131491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:18.133145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:18.134047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:18.134047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:18.134047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:18.134047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 617/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:18.139211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:18.237688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:18.249005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03ef9-f111-459f-9cb5-85473f7d6824 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:18.286159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85136d-d153-405a-a674-439684f7298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:18.286792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85136d-d153-405a-a674-439684f7298f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:18.287072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85136d-d153-405a-a674-439684f7298f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:18.287344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85136d-d153-405a-a674-439684f7298f None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:18.287984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85136d-d153-405a-a674-439684f7298f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:18.288286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85136d-d153-405a-a674-439684f7298f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:18.289644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85136d-d153-405a-a674-439684f7298f None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:18.301463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 626/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:18.307756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:18.389361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:18.424000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cef06-1530-4315-9e16-124f1ab0d881 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:18.461610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:18.462243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:18.462524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:18.462853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:18.471759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:18.473217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:40:18.484795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:18.485897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:18.487005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 618/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:18.492505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85136d-d153-405a-a674-439684f7298f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:18.606752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85136d-d153-405a-a674-439684f7298f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:18.653597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:18.654170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:18.654446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:18.654756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:18.655460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:18.655736 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:18.657154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c494-43f7-43de-b754-8cb378b2f67e None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:18.671073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 627/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:18.677774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:18.791175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cd4f9-a8a8-4178-b8ce-ed43fc789b60 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:18.835646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:18.836603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:18.837077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:18.837535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:18.838665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] RBAC: Adding query filter params (role.id=79a1959b832e471fa2b0385028524292, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=3a3f00cae3d04d2fa79ed4481ce024aa) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:18.839185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:18.841267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d7697-6bb0-40f2-b031-99b804e55dd2 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:18.850320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 619/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:40:18 2022] GET /identity/v3/role_assignments?user.id=3a3f00cae3d04d2fa79ed4481ce024aa&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=79a1959b832e471fa2b0385028524292 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:20.955780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef7b3a-d65f-44a0-8537-9cb9fa5666ca None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:20.956342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef7b3a-d65f-44a0-8537-9cb9fa5666ca None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:20.956458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef7b3a-d65f-44a0-8537-9cb9fa5666ca None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:20.957833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 628/1247] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:20.963923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:20.964409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:20.964500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:20.971530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:20.985754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:20.987081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:21.066088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 620/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:21.357370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef7b3a-d65f-44a0-8537-9cb9fa5666ca None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:21.376554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:21.480378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef7b3a-d65f-44a0-8537-9cb9fa5666ca None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:21.520593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:21.521413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:21.521724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:21.522027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:21.533617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:40:21.538651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:21.540902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:21.541840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 629/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:21.547873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:21.673873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2f15e-5fd6-4752-9bcf-c36f514a7b3a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:21.713917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:21.721600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:21.722362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:21.722709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:21.723011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:21.723806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:21.724184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:21.725665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:21.739345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 621/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:40:21.740793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:21.833469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:21.860868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9ff2-492e-4ef4-9460-f9ac95a9e213 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:21.900758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:21.901550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:21.901815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:21.902154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:21.914110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:21.915689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:21.931937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:21.932975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:21.933892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:21.933892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:21.933892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:21.933892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 630/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:21.939424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:22.049727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bee9-108f-43f7-ac1e-cad549997712 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:22.087969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:22.088573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:22.088851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:22.089122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:22.089753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:22.090056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:22.091421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:22.104696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 622/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:22.111377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:22.228897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7fc1e-fa26-48b7-b350-780105238f38 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:22.254859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:22.262917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:22.263543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:22.263822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:22.264094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:22.271381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:22.272814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:40:22.284081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:22.285353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:22.286345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 631/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:22.291905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:22.356298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:22.407169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481e1b-d2a9-4d03-8ff2-6734a060ff23 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:22.448982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:22.449680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:22.449997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:22.450382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:22.451227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:22.451535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:22.452936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:22.474351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 623/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 12 11:40:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:22.480236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:22.598246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bca994-4684-4b70-a8a9-a830185de4ae None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:22.644258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:22.644974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:22.645306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:22.645584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:22.710527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:22.727234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:22.730385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:22.841232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 632/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:40:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:40:22.847393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:22.962073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f5c49-126e-4cb2-a91a-e6a355e0fb11 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:22.975455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:22.998067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:22.998650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:22.998933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:22.999202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:23.010084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:23.011677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:23.026846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:23.028056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:23.029182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:23.029182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:23.029182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:23.032737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 624/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:23.033714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:23.154297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:23.168900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d0a6e-1529-4559-958b-6f3452d3cc11 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:23.205058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:23.205653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:23.205930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:23.206194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:23.206858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:23.207160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:23.208511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:23.220631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 633/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:23.226473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:23.338329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926b49-32dd-4356-b738-71a1def72b06 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:23.379345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:23.379994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:23.380270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:23.380544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:23.388318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:23.389906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:40:23.402154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:23.403672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:23.404870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 625/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:40:23.409303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:23.516150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38ca1-fea0-484f-9881-2a0d22e0114a None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:23.553558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:23.554301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:23.555254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:23.555554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:23.556244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:23.556645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:23.558107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819dc71-26c4-4df0-a530-845ff9c05229 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:23.573091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 634/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:23.579941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:23.610557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:23.694924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2889455-7faa-416c-bdf4-f9e46d96bcb5 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:23.730827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:23.731542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:23.731865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:23.732143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:23.732949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=3a3f00cae3d04d2fa79ed4481ce024aa) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:23.733260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:23.734796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eb90b-cbda-4dfe-8c8c-44a2fdc9ca57 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:23.741038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 626/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:40:23 2022] GET /identity/v3/role_assignments?user.id=3a3f00cae3d04d2fa79ed4481ce024aa&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:25.605170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1905d-aa53-4064-a3fb-45e34e4a5d47 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:25.605717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1905d-aa53-4064-a3fb-45e34e4a5d47 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:25.605717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1905d-aa53-4064-a3fb-45e34e4a5d47 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:25.607065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 635/1261] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:25.612039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:25.612423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:25.612580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:25.631282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:25.632476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:25.695519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 627/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:25.959190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1905d-aa53-4064-a3fb-45e34e4a5d47 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:25.969947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:26.056639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1905d-aa53-4064-a3fb-45e34e4a5d47 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:26.097097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:26.097717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:26.097992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:26.098260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:26.107998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:40:26.112655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:26.113743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:26.114663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 636/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:26.120233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:26.138360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:26.214623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1683e1-001c-4867-92c3-ec86d5b9274d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:26.247192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:26.247783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:26.248060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:26.248330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:26.248976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:26.249275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:26.250643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:26.258205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 628/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:40:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:26.263826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:26.327905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:26.361609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083dff4-2caf-4d6c-bd97-66f0790b8f7f None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:26.395126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:26.395672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:26.395947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:26.396218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:26.406245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:26.407689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:26.421394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:26.422530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:26.423472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:26.423472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:26.423472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:26.423472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 637/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:26.428394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:26.504379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:26.523000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd03e0-b721-4738-b0fd-c739a9a078f4 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:26.560496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:26.561218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:26.561576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:26.561937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:26.562638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:26.562984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:26.564728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:26.579827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 629/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:26.585732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:26.689712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627d4b-4fa6-410f-b900-ba606401271d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:26.708734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:26.722377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:26.723023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:26.723302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:26.723574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] PATH_INFO: `/v3/users/placement` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:26.731437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:26.732861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:40:26.743963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:26.745030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:26.746213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 638/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:26.750928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:26.847081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22829ae4-e77a-437a-9439-4e929306e73b None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:26.880171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:26.880771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:26.881047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:26.881318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:26.882030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:26.882332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:26.884339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:26.892593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:26.901099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 630/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 12 11:40:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:26.906705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:27.002390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d871-c715-45f6-bcf1-7fb010424dcf None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:27.033972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:27.034633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:27.034906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:27.035179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:27.045680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:27.047137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:27.061202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:27.062320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:27.063397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:27.063397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:27.063397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:27.063397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 639/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:27.068003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:27.161528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3b24-0afe-40fb-ac71-5e5043abc53a None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:27.194339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:27.194974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:27.195258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:27.195534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:27.196167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:27.196471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:27.197808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:27.208632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 631/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:27.214216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:27.245017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:27.310576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491eea3-870d-402b-9a86-eb7163e4b368 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:27.342928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:27.343539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:27.343819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:27.344092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:27.350428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:27.352508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:40:27.363291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:27.364223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:27.365129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 640/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:27.370776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:27.426956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:27.469981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923b83-8405-49d0-b2b0-c5b7fad217cd None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:27.501729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:27.502322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:27.502628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:27.502907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:27.503583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:27.503888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:27.505291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589d519-06f4-4a00-93ec-89d86d3f895e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:27.517103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 632/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:27.523178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:27.618398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:27.627276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c1b7-238f-4b5a-a5ab-3237d0b946b8 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:27.659339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663161f6-8b83-491a-a87c-7b767bfe6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:27.659979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663161f6-8b83-491a-a87c-7b767bfe6740 None admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:27.660256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663161f6-8b83-491a-a87c-7b767bfe6740 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:27.660526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663161f6-8b83-491a-a87c-7b767bfe6740 None admin] PATH_INFO: `/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/3a3f00cae3d04d2fa79ed4481ce024aa/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:27.662354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663161f6-8b83-491a-a87c-7b767bfe6740 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e67f8f820364780aba886ef5fdcf891, user_id=3a3f00cae3d04d2fa79ed4481ce024aa, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:27.664292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663161f6-8b83-491a-a87c-7b767bfe6740 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:27.676150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 641/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 12 11:40:27 2022] PUT /identity/v3/projects/0e67f8f820364780aba886ef5fdcf891/users/3a3f00cae3d04d2fa79ed4481ce024aa/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:40:29.542381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b7bf2-7a94-40bc-a65a-b421c2857d9a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:29.543133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b7bf2-7a94-40bc-a65a-b421c2857d9a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:29.543133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b7bf2-7a94-40bc-a65a-b421c2857d9a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:29.544406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 633/1274] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:29.550381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:29.550875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:29.551122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:29.572513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:29.573695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:29.636281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 642/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:29.901440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b7bf2-7a94-40bc-a65a-b421c2857d9a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:29.998485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b7bf2-7a94-40bc-a65a-b421c2857d9a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.014627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:30.030903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.031514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.031794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.032068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:30.042149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:40:30.046828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:30.047995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:30.049067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 634/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 12 11:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:30.053798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:30.132183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:30.150330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931037-3560-497e-86b2-1ff3a3fc8cda None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.184085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.184678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.184956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.185251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:30.185907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:30.186206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:30.187595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:30.195760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 643/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 12 11:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:30.201459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:30.296517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615704e-fbdd-47cb-a6f9-34ee23ced1cb None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.329646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.330250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.330534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.330843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:30.340405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:30.341819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:30.355752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:30.356911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:30.358041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:30.358041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:30.358041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:30.358041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 635/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:30.362373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:30.458683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3928b-1f8d-4b3f-af44-458084a1d5ec None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.490279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.490887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.491168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.491440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:30.492558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:30.492853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:30.494189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:30.505434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 644/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:30.511470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:30.540989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:30.611072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339dd4-42d5-4f16-8a0f-80c7c8ddb750 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.643343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.643952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.644230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.644500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:30.651552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:30.652974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:40:30.663459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:30.665081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:30.666082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 636/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:30.670865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:30.674632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:30.766423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1e91-6de9-4601-8f1d-57b671e10399 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.798882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.799466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.799741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.800010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:30.800715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:30.801013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:30.802417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:30.819224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 645/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 12 11:40:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:30.824761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:30.913791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:30.924571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d647b5f-28c9-4aad-a2b2-782e3ee72d90 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:30.956871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:30.957461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:30.957740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:30.958010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:31.020921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:31.022282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:31.105284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:31.115472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 637/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 12 11:40:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:40:31.121735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:31.180782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:31.218260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c09b-ba76-4e7e-b070-ec4a16dc4239 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:31.250904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:31.251515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:31.251791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:31.252062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:31.262443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:31.263906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:40:31.277677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:31.278769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:40:31.279758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:40:31.279758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:40:31.279758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:31.279758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 646/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:31.284164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:31.378564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1a2f1-de82-460a-9032-2c3d0c03d80e None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:31.410797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:31.411383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:31.411668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:31.411942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:31.412572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:31.412874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:31.414752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:31.425299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 638/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 12 11:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:31.431592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:31.526588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8fcc-afb0-42f7-8d33-5992a8cd8c4c None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:31.540208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:31.563465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:31.564149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:31.564429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:31.564725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:31.572268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:31.573757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:40:31.586493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:31.587779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:40:31.588915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: ERROR keystone.server.flask.application Aug 12 11:40:31.590778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 647/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 12 11:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:40:31.594157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:31.642748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:31.691353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f2409-dfd7-49aa-a3ca-2b8d35e08257 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:31.722911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:31.723507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:31.723790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:31.724065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:31.724751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:31.725057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:31.726996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52f3d-fd6d-4562-86f4-c978208f5bc5 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:31.738325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 639/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 12 11:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:31.744951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:31.840759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7bc24-f922-47a1-b6db-6a20a50ef641 None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:31.873604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:31.874291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:31.874453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:31.874754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:31.875467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] RBAC: Adding query filter params (role.id=18025b295a624a3cb873b1f75c4f73a4, scope.project.id=0e67f8f820364780aba886ef5fdcf891, user.id=3a3f00cae3d04d2fa79ed4481ce024aa) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:31.875774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:31.877187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd49b1d-c006-4a32-926d-8a45d53745b9 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:31.883375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 648/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 12 11:40:31 2022] GET /identity/v3/role_assignments?user.id=3a3f00cae3d04d2fa79ed4481ce024aa&scope.project.id=0e67f8f820364780aba886ef5fdcf891&role.id=18025b295a624a3cb873b1f75c4f73a4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:33.767425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bbd5f-aba5-42b1-a3e2-1e315990a727 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:33.767949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bbd5f-aba5-42b1-a3e2-1e315990a727 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:33.768073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bbd5f-aba5-42b1-a3e2-1e315990a727 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:33.769323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 640/1288] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:33.774955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:33.775375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:33.775502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:33.793499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:33.794723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:33.828851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:33.865947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 649/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:34.129598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bbd5f-aba5-42b1-a3e2-1e315990a727 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:34.227061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bbd5f-aba5-42b1-a3e2-1e315990a727 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:34.237141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:34.259764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:34.260375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:34.260653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:34.260926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:34.261498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:34.262864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:34.271355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:34.272555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:34.274097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 641/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:40:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:34.278766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:34.372512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7c06-8687-4e81-bcb7-0cc054b5d72d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:34.404830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:34.405358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:34.405635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:34.405904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:34.406523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:34.406848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:34.408188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374e48-eedc-4fd7-8914-18a6af691a0a None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:34.412753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 650/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 12 11:40:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:34.418714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:34.515199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c4bd2-905f-432f-afde-2b0922958244 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:34.549664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:34.550318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:34.550683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:34.551120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] PATH_INFO: `/v3/services` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:34.551854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] RBAC: Adding query filter params (type=placement) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:34.552221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:34.553913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff6b1-87a1-4c53-8179-4791ed92dede None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:34.560324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 642/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 12 11:40:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:36.454911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2874c6-05fb-4654-9cd0-6e147ff16d07 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:36.455466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2874c6-05fb-4654-9cd0-6e147ff16d07 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:36.455466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2874c6-05fb-4654-9cd0-6e147ff16d07 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:36.456788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 651/1293] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:36.462372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a1cb-ad5c-446e-b853-409c9b535d5a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:36.462814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a1cb-ad5c-446e-b853-409c9b535d5a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:36.462934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a1cb-ad5c-446e-b853-409c9b535d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:36.480833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-baa0a1cb-ad5c-446e-b853-409c9b535d5a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:36.481997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-baa0a1cb-ad5c-446e-b853-409c9b535d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:36.509611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:36.547148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 643/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:36.822984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2874c6-05fb-4654-9cd0-6e147ff16d07 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:36.853774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:36.922498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2874c6-05fb-4654-9cd0-6e147ff16d07 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:36.954972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69c7c1-19a0-4705-85e9-62dec1202e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:36.955568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c7c1-19a0-4705-85e9-62dec1202e94 None admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:36.955847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c7c1-19a0-4705-85e9-62dec1202e94 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:36.956120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c7c1-19a0-4705-85e9-62dec1202e94 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:36.956765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69c7c1-19a0-4705-85e9-62dec1202e94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:36.958120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69c7c1-19a0-4705-85e9-62dec1202e94 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:36.972164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 652/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 12 11:40:36 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:40:38.837545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3844a-337c-4d1a-8608-3d8372607eb5 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:38.838095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3844a-337c-4d1a-8608-3d8372607eb5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:38.838188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3844a-337c-4d1a-8608-3d8372607eb5 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:38.839494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 644/1296] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:38.844502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:38.844957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:38.845051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:38.862551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:38.863743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:38.934769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 653/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:39.203747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3844a-337c-4d1a-8608-3d8372607eb5 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:39.308720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3844a-337c-4d1a-8608-3d8372607eb5 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:39.340789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:39.341403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:39.341684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:39.341955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] PATH_INFO: `/v3/services/placement` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:39.342524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:39.343902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:39.352265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:39.353448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:39.354508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 645/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:40:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:39.359372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:39.377371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:39.456001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301090e-3d77-49ea-b288-e063564dcb7a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:39.491450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:39.492563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:39.492840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:39.493111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:39.493734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] RBAC: Adding query filter params (name=placement) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:39.494033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:39.495427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:39.500314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 654/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 12 11:40:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:39.506144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:39.537354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:39.617313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cae1-28c8-4420-af03-041361a0f37f None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:39.650869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:39.651467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:39.651751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:39.652025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:39.652715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] RBAC: Adding query filter params (interface=public, service_id=16cdb651a479465cb448397885b8db37, region_id=RegionOne) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:39.653023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:39.654406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c54496-eb18-45f0-88df-36de9bdecabf None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:39.659231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 646/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 12 11:40:39 2022] GET /identity/v3/endpoints?service_id=16cdb651a479465cb448397885b8db37&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:39.665435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:39.745373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:39.763402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324e60-77b8-4e00-bfa7-b0046136007d None admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:39.796884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d7ad0-c745-425b-8dcc-d6db4c37ffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:39.797479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7ad0-c745-425b-8dcc-d6db4c37ffdf None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:39.797755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7ad0-c745-425b-8dcc-d6db4c37ffdf None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:39.798022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d7ad0-c745-425b-8dcc-d6db4c37ffdf None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:39.798645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d7ad0-c745-425b-8dcc-d6db4c37ffdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:39.800002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d7ad0-c745-425b-8dcc-d6db4c37ffdf None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:39.806870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 655/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 12 11:40:39 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:40:41.675888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870305be-0667-4320-9ae0-cda588d6188e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:41.676452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870305be-0667-4320-9ae0-cda588d6188e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:41.676452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870305be-0667-4320-9ae0-cda588d6188e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:41.677783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 647/1302] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:40:41.683517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:41.683948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:41.684049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:41.702076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:40:41.703289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:40:41.768470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 656/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:40:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:40:42.032021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870305be-0667-4320-9ae0-cda588d6188e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:42.123895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:42.130978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870305be-0667-4320-9ae0-cda588d6188e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:42.165743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:42.166357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:42.166665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:42.166940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:42.167515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:42.168863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:40:42.177219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:40:42.178356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application with Lock( Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: ERROR keystone.server.flask.application Aug 12 11:40:42.179449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 648/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 12 11:40:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:40:42.184523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:42.258884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:42.281857 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f5a18-7227-43eb-a640-3e29ee78874e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:42.314712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:42.315309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:42.315586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:42.315856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] PATH_INFO: `/v3/services` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:42.316478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:40:42.316776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:42.318138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a580e3-0b3e-4c9b-b039-789d5803fb72 None admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:42.323700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 657/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 12 11:40:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:40:42.329543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:40:42.429276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4780b2-63ca-4f9c-ba16-1225af6c24c8 None admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:40:42.462153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61604d7f-1b86-4b67-8a57-e4341ae10e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:40:42.462776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604d7f-1b86-4b67-8a57-e4341ae10e67 None admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:40:42.463059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604d7f-1b86-4b67-8a57-e4341ae10e67 None admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:40:42.463330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61604d7f-1b86-4b67-8a57-e4341ae10e67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:40:42.464059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61604d7f-1b86-4b67-8a57-e4341ae10e67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:40:42.465400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61604d7f-1b86-4b67-8a57-e4341ae10e67 None admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:40:42.484331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 649/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:40:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:40:52.320758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=30 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:40:52.480079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:45.658564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa791-cbe8-4981-98cf-fc214413504e None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:45.659125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa791-cbe8-4981-98cf-fc214413504e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:45.659125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa791-cbe8-4981-98cf-fc214413504e None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:45.665871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1797b8-dd9c-4808-abac-ba9dcaa6a369 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:45.666286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1797b8-dd9c-4808-abac-ba9dcaa6a369 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:45.666456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1797b8-dd9c-4808-abac-ba9dcaa6a369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:45.671144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 658/1307] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:41:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:45.751412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4a1797b8-dd9c-4808-abac-ba9dcaa6a369 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:45.752608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4a1797b8-dd9c-4808-abac-ba9dcaa6a369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:46.000804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 650/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:41:46.296318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c4424-af92-4842-b2d6-63fd7e1d905a None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:46.296963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c4424-af92-4842-b2d6-63fd7e1d905a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:46.297610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c4424-af92-4842-b2d6-63fd7e1d905a None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:46.299465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 659/1309] 10.222.0.42 () {54 vars in 965 bytes} [Fri Aug 12 11:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:46.308906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd8af1-cfc2-4d86-a7fd-7376c3a24496 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:46.309199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd8af1-cfc2-4d86-a7fd-7376c3a24496 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:46.309482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd8af1-cfc2-4d86-a7fd-7376c3a24496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:46.391778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-76bd8af1-cfc2-4d86-a7fd-7376c3a24496 None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:46.392988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-76bd8af1-cfc2-4d86-a7fd-7376c3a24496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:46.416399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:46.476792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 651/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Aug 12 11:41:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:41:46.486035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c4424-af92-4842-b2d6-63fd7e1d905a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:41:46.488089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d27c4424-af92-4842-b2d6-63fd7e1d905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:46.611230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c4424-af92-4842-b2d6-63fd7e1d905a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:41:46.694159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:41:46.696108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:46.696537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:46.696955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:46.698974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:46.759442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:46.845706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:41:46.847477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd176f41-8ea1-447f-8167-f7afc3f7c97e service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:41:46.870299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 660/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:41:49.112593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a07587-5262-4b8f-b8f8-999967151c8e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:49.113126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a07587-5262-4b8f-b8f8-999967151c8e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:49.113126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a07587-5262-4b8f-b8f8-999967151c8e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:49.114481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 652/1312] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:49.120264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb40ae9-e05b-4413-b03f-5ce03275b559 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:49.120704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb40ae9-e05b-4413-b03f-5ce03275b559 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:49.120961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb40ae9-e05b-4413-b03f-5ce03275b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:49.190551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-acb40ae9-e05b-4413-b03f-5ce03275b559 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:49.191849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-acb40ae9-e05b-4413-b03f-5ce03275b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:49.298448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 661/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:41:49.581915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a07587-5262-4b8f-b8f8-999967151c8e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:41:49.583504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-67a07587-5262-4b8f-b8f8-999967151c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:49.687899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a07587-5262-4b8f-b8f8-999967151c8e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:41:49.755893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:49.758320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:41:49.759026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:49.759298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:49.759756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:49.761737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:49.868914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:41:49.870304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1605dc-ec4f-4dae-925c-2b161fa89fc3 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:41:49.888694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 653/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:41:52.081449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b770fc-4387-493b-bc8c-d10c02acb2e6 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:52.081978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b770fc-4387-493b-bc8c-d10c02acb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:52.081978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b770fc-4387-493b-bc8c-d10c02acb2e6 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:52.083363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 662/1315] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:52.088856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475849a8-0f32-4a51-be4d-bc7cb30760fc None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:52.089279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475849a8-0f32-4a51-be4d-bc7cb30760fc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:52.089416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475849a8-0f32-4a51-be4d-bc7cb30760fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:52.153382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-475849a8-0f32-4a51-be4d-bc7cb30760fc None None] MFA Rules not processed for user `75a946fcd4484fcca6a90b54668cd390`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:52.154520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-475849a8-0f32-4a51-be4d-bc7cb30760fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:52.205401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:52.248726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 654/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:41:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:41:52.528258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b770fc-4387-493b-bc8c-d10c02acb2e6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:41:52.529780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-38b770fc-4387-493b-bc8c-d10c02acb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:52.539952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:52.637855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b770fc-4387-493b-bc8c-d10c02acb2e6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:41:52.707357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:41:52.707953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:52.708228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:52.708499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:52.710102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:52.770332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:52.816050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:41:52.817469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85df6a5-61ac-4e85-b7ec-cbbe1c61568a service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:41:52.835651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 663/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:41:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:41:55.301833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3e24-6c62-4439-8711-ad1aafc8de0c None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:55.302364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3e24-6c62-4439-8711-ad1aafc8de0c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:55.302364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3e24-6c62-4439-8711-ad1aafc8de0c None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:55.303686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 655/1318] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:55.309223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af577a5-af7b-48d9-8c0c-b9ec34c38b8f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:55.309649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af577a5-af7b-48d9-8c0c-b9ec34c38b8f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:55.309775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af577a5-af7b-48d9-8c0c-b9ec34c38b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:55.373252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0af577a5-af7b-48d9-8c0c-b9ec34c38b8f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:55.374438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0af577a5-af7b-48d9-8c0c-b9ec34c38b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:55.467957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 664/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:41:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:41:55.764069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65905-2522-45b7-8f7d-59821d77cde7 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:55.764381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65905-2522-45b7-8f7d-59821d77cde7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:55.764660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65905-2522-45b7-8f7d-59821d77cde7 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:55.766005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 656/1320] 10.222.0.42 () {54 vars in 965 bytes} [Fri Aug 12 11:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:55.771646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64258-f3ac-4a5f-960c-99f33fcacde5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:55.771929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64258-f3ac-4a5f-960c-99f33fcacde5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:55.772200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64258-f3ac-4a5f-960c-99f33fcacde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:55.793810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:55.847363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f3b64258-f3ac-4a5f-960c-99f33fcacde5 None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:55.848474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f3b64258-f3ac-4a5f-960c-99f33fcacde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:55.925886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 665/1321] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Aug 12 11:41:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:41:55.935653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65905-2522-45b7-8f7d-59821d77cde7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:41:55.937216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-23c65905-2522-45b7-8f7d-59821d77cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:56.038052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65905-2522-45b7-8f7d-59821d77cde7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:41:56.108691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:41:56.109219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:56.109496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:56.109765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:56.111360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:56.118591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:56.217849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:41:56.219292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af7c1f-a86b-48ec-ae60-57e083abe4bd service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:41:56.238291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 657/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:41:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:41:59.241269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747ac5-99ce-4ffb-995c-8e5eef479786 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:59.241924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747ac5-99ce-4ffb-995c-8e5eef479786 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:59.241924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747ac5-99ce-4ffb-995c-8e5eef479786 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:59.244188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 666/1323] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:41:59.248280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d818-968f-44ab-b12f-46504e6426c1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:59.248732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d818-968f-44ab-b12f-46504e6426c1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:59.248826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d818-968f-44ab-b12f-46504e6426c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:59.314575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3327d818-968f-44ab-b12f-46504e6426c1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:41:59.315797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3327d818-968f-44ab-b12f-46504e6426c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:59.372556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:59.412271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 658/1324] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:41:59.693604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747ac5-99ce-4ffb-995c-8e5eef479786 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:41:59.695744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3b747ac5-99ce-4ffb-995c-8e5eef479786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:59.796448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747ac5-99ce-4ffb-995c-8e5eef479786 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:41:59.808480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:41:59.871904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:41:59.872411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:41:59.872690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:41:59.872963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:41:59.874702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:41:59.984638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:41:59.986111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a392-af7d-4e9d-b466-8f75f3f43a89 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:00.003600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 667/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:01.965193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85828b-0da2-467a-aaab-b65ebb07de3b None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:01.965746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85828b-0da2-467a-aaab-b65ebb07de3b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:01.965746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85828b-0da2-467a-aaab-b65ebb07de3b None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:01.967165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 659/1326] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:01.972128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c400-9799-4203-aef2-30cbbe0a4777 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:01.972531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c400-9799-4203-aef2-30cbbe0a4777 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:01.972676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c400-9799-4203-aef2-30cbbe0a4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:02.020018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:02.038185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fd99c400-9799-4203-aef2-30cbbe0a4777 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:02.039402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fd99c400-9799-4203-aef2-30cbbe0a4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:02.133635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 668/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:02.414017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85828b-0da2-467a-aaab-b65ebb07de3b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:02.415594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fb85828b-0da2-467a-aaab-b65ebb07de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:02.523774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85828b-0da2-467a-aaab-b65ebb07de3b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:02.599963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:02.600598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:02.600880 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:02.601155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:02.602795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:02.619030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:02.713074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:02.714419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f98433-9036-429d-8106-e076f5bdd35e service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:02.732951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 660/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:04.697434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a68e4-4f76-4c57-abc0-85fb81a53a43 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:04.697952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a68e4-4f76-4c57-abc0-85fb81a53a43 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:04.697952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a68e4-4f76-4c57-abc0-85fb81a53a43 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:04.699355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 669/1329] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:04.704702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582c42-c20f-4538-806d-0ad120d54712 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:04.705136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582c42-c20f-4538-806d-0ad120d54712 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:04.705261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582c42-c20f-4538-806d-0ad120d54712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:04.775945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-86582c42-c20f-4538-806d-0ad120d54712 None None] MFA Rules not processed for user `75a946fcd4484fcca6a90b54668cd390`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:04.777152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-86582c42-c20f-4538-806d-0ad120d54712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:04.842620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:04.879181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 661/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:05.159854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a68e4-4f76-4c57-abc0-85fb81a53a43 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:05.161388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-523a68e4-4f76-4c57-abc0-85fb81a53a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:05.269137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a68e4-4f76-4c57-abc0-85fb81a53a43 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:05.288501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:05.341139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:05.341741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:05.342018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:05.342287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:05.343968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:05.452656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:05.454025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424a0dc-d1e0-4739-960a-357e3a1da4bb service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:05.471944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 670/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:07.664285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de333c8-f834-4731-bb53-92e2a53a95f0 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:07.664819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de333c8-f834-4731-bb53-92e2a53a95f0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:07.664819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de333c8-f834-4731-bb53-92e2a53a95f0 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:07.666185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 662/1332] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:07.671306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d279f-c102-4c2c-8df7-81c83e752d96 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:07.671688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d279f-c102-4c2c-8df7-81c83e752d96 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:07.671863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d279f-c102-4c2c-8df7-81c83e752d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:07.745019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:07.747818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0c7d279f-c102-4c2c-8df7-81c83e752d96 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:07.749544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0c7d279f-c102-4c2c-8df7-81c83e752d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:07.846663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 671/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:08.133876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de333c8-f834-4731-bb53-92e2a53a95f0 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:08.135450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6de333c8-f834-4731-bb53-92e2a53a95f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:08.236196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de333c8-f834-4731-bb53-92e2a53a95f0 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:08.308485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:08.309089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:08.309366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:08.309638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:08.311275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:08.339985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:08.421280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:08.422670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcff26d-2ea0-4bf0-965f-fd3aed4e59ed service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:08.441052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 663/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:10.362684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb019-0f50-4802-b4d8-cfd313b671db None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:10.363239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb019-0f50-4802-b4d8-cfd313b671db None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:10.363239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb019-0f50-4802-b4d8-cfd313b671db None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:10.364567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 672/1335] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:10.369723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb78b6f-c5a1-4dc3-8487-d17e47948957 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:10.370156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb78b6f-c5a1-4dc3-8487-d17e47948957 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:10.370289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb78b6f-c5a1-4dc3-8487-d17e47948957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:10.434696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-efb78b6f-c5a1-4dc3-8487-d17e47948957 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:10.435904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-efb78b6f-c5a1-4dc3-8487-d17e47948957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:10.508592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:10.534757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 664/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:10.821044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb019-0f50-4802-b4d8-cfd313b671db None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:10.822584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7e4cb019-0f50-4802-b4d8-cfd313b671db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:10.923141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb019-0f50-4802-b4d8-cfd313b671db None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:10.951038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:10.994176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:10.994798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:10.995077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:10.995363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:10.996937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:11.108606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:11.109970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c90d3-4edf-4697-9da8-486923ba83ab service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:11.128015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 673/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:13.366759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684413-313b-4ffc-94ed-8ea3d1af03fc None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:13.367311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684413-313b-4ffc-94ed-8ea3d1af03fc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:13.367311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684413-313b-4ffc-94ed-8ea3d1af03fc None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:13.368660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 665/1338] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:13.373675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44333-9d72-4a42-85e6-d679884e56f3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:13.374054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44333-9d72-4a42-85e6-d679884e56f3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:13.374237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44333-9d72-4a42-85e6-d679884e56f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:13.439281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-29d44333-9d72-4a42-85e6-d679884e56f3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:13.440472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-29d44333-9d72-4a42-85e6-d679884e56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:13.448898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:13.538193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 674/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:13.817532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee684413-313b-4ffc-94ed-8ea3d1af03fc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:13.819146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ee684413-313b-4ffc-94ed-8ea3d1af03fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:13.921756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee684413-313b-4ffc-94ed-8ea3d1af03fc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:13.993219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:13.993804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:13.994076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:13.994343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:13.995950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:14.031300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:14.103987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:14.105337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcccad-1d6f-498a-9984-45a6e9eef86b service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:14.124470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 666/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:17.989005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e2577-06ed-45f1-9cc9-b0e9ee1cb221 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:17.989523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e2577-06ed-45f1-9cc9-b0e9ee1cb221 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:17.989604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e2577-06ed-45f1-9cc9-b0e9ee1cb221 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:17.991115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 675/1341] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:17.996753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6338e21-ed6a-4216-825b-93801393fbbc None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:17.997223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6338e21-ed6a-4216-825b-93801393fbbc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:17.997314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6338e21-ed6a-4216-825b-93801393fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:18.184078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c6338e21-ed6a-4216-825b-93801393fbbc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:18.185218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c6338e21-ed6a-4216-825b-93801393fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:18.270349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:18.282778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 667/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:18.562665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e2577-06ed-45f1-9cc9-b0e9ee1cb221 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:18.564196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-347e2577-06ed-45f1-9cc9-b0e9ee1cb221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:18.666724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e2577-06ed-45f1-9cc9-b0e9ee1cb221 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:18.704388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:18.740292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:18.740899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:18.741711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:18.741982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:18.743584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:18.852021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:18.853451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a82616-8269-4e42-b8af-03db42352348 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:18.877117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 676/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:21.383813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2327-0aea-4c3f-8dab-7c0991588bd6 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:21.384358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2327-0aea-4c3f-8dab-7c0991588bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:21.384358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2327-0aea-4c3f-8dab-7c0991588bd6 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:21.385706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 668/1344] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:21.391061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba59b7a-b8ef-45f5-b3bf-a06cbdc3e656 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:21.391484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba59b7a-b8ef-45f5-b3bf-a06cbdc3e656 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:21.391618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba59b7a-b8ef-45f5-b3bf-a06cbdc3e656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:21.474895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cba59b7a-b8ef-45f5-b3bf-a06cbdc3e656 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:21.476831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cba59b7a-b8ef-45f5-b3bf-a06cbdc3e656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:21.503768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:21.586398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 677/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:21.866846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2327-0aea-4c3f-8dab-7c0991588bd6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:21.868359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-40af2327-0aea-4c3f-8dab-7c0991588bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:21.974635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2327-0aea-4c3f-8dab-7c0991588bd6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:22.051988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:22.052598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:22.052875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:22.053142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:22.055286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:22.099013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:22.168228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:22.169648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569193f1-b3cc-47d7-b52e-98c3f09bdaa8 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:22.188037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 669/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:26.088430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c70bf6-5a6f-4ae4-8600-82133f13690d None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:26.088938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c70bf6-5a6f-4ae4-8600-82133f13690d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:26.089028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c70bf6-5a6f-4ae4-8600-82133f13690d None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:26.090330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 678/1347] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:26.095805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6a8e-2786-4c58-859d-bd44e4638b93 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:26.096293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6a8e-2786-4c58-859d-bd44e4638b93 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:26.096407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6a8e-2786-4c58-859d-bd44e4638b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:26.166668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2fae6a8e-2786-4c58-859d-bd44e4638b93 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:26.167902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2fae6a8e-2786-4c58-859d-bd44e4638b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:26.267220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:26.270187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 670/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:42:26.559738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c70bf6-5a6f-4ae4-8600-82133f13690d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:26.561270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b6c70bf6-5a6f-4ae4-8600-82133f13690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:26.663717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c70bf6-5a6f-4ae4-8600-82133f13690d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:26.709218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:26.735609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:26.736208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:26.736484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:26.736754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:26.738351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:26.844336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:26.845701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f999-7e09-48a4-9859-2ef8309f43f9 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:26.866986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 679/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:31.779336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253b9f-748f-4f3b-887f-e9c9c746bc09 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:31.779893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253b9f-748f-4f3b-887f-e9c9c746bc09 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:31.779893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253b9f-748f-4f3b-887f-e9c9c746bc09 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:31.781350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 671/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:31.788673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a3785-029a-4875-93b4-0b69950e481c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:31.789484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a3785-029a-4875-93b4-0b69950e481c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:31.789764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a3785-029a-4875-93b4-0b69950e481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:31.872395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-617a3785-029a-4875-93b4-0b69950e481c None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:31.872395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-617a3785-029a-4875-93b4-0b69950e481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:31.891585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:32.035275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 680/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:42:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:36.330059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1737cd7-bb21-4b92-8420-e8e4b3476431 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:36.330631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1737cd7-bb21-4b92-8420-e8e4b3476431 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:36.330631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1737cd7-bb21-4b92-8420-e8e4b3476431 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:36.332149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 672/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:36.337070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092054b-8482-47af-92cd-fb142c275534 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:36.337530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092054b-8482-47af-92cd-fb142c275534 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:36.337846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092054b-8482-47af-92cd-fb142c275534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:36.415551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a092054b-8482-47af-92cd-fb142c275534 None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:36.416766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a092054b-8482-47af-92cd-fb142c275534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:36.497322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:36.537086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 681/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:42:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:37.695881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36a21-2b70-4de3-88bb-0214575d166b None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:37.696431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36a21-2b70-4de3-88bb-0214575d166b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:37.696688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36a21-2b70-4de3-88bb-0214575d166b None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:37.698187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 673/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:37.703668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff5e4-6470-4f22-adfe-7155490c881f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:37.704076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff5e4-6470-4f22-adfe-7155490c881f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:37.704285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff5e4-6470-4f22-adfe-7155490c881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:37.780134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ce2ff5e4-6470-4f22-adfe-7155490c881f None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:37.781318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ce2ff5e4-6470-4f22-adfe-7155490c881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:37.892745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 682/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:42:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:42:41.254470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab516ec-627f-4071-9f60-edcadc8b7084 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:41.255054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab516ec-627f-4071-9f60-edcadc8b7084 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:41.255054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab516ec-627f-4071-9f60-edcadc8b7084 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:41.256412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 674/1356] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:41.262148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe865-ae6a-4f04-9fac-798fb91e7d96 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:41.262543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe865-ae6a-4f04-9fac-798fb91e7d96 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:41.262843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe865-ae6a-4f04-9fac-798fb91e7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:41.298027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:41.352673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-431fe865-ae6a-4f04-9fac-798fb91e7d96 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:41.354046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-431fe865-ae6a-4f04-9fac-798fb91e7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:41.476378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 683/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:41.783678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f9e98-1f5d-4299-bf88-79aa8a099a7a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:41.784399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f9e98-1f5d-4299-bf88-79aa8a099a7a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:41.784890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f9e98-1f5d-4299-bf88-79aa8a099a7a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:41.786867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 675/1358] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 12 11:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:41.799068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb44e6-f562-4bff-b2b6-3cac09a16158 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:41.799694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb44e6-f562-4bff-b2b6-3cac09a16158 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:41.800223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb44e6-f562-4bff-b2b6-3cac09a16158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:41.889600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7bdb44e6-f562-4bff-b2b6-3cac09a16158 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:41.890815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7bdb44e6-f562-4bff-b2b6-3cac09a16158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:41.956519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:42.040217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 684/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 12 11:42:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:42.041121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f9e98-1f5d-4299-bf88-79aa8a099a7a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:42.042905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c92f9e98-1f5d-4299-bf88-79aa8a099a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:42.203313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f9e98-1f5d-4299-bf88-79aa8a099a7a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:42.279492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:42.324237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:42.325363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:42.325852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:42.326365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:42.328338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:42.420551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:42.422301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f76a47-c7d3-4d55-9948-a0cdbd4170a7 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:42.441435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 676/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:42:44.628059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac3597-923e-41e9-ba22-5002e2c89e80 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:44.628598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac3597-923e-41e9-ba22-5002e2c89e80 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:44.628598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac3597-923e-41e9-ba22-5002e2c89e80 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:44.629991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 685/1361] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:44.636001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f924e8-28bc-4d7d-9133-18417d215d42 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:44.636399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f924e8-28bc-4d7d-9133-18417d215d42 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:44.636556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f924e8-28bc-4d7d-9133-18417d215d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:44.708121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c1f924e8-28bc-4d7d-9133-18417d215d42 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:44.709319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c1f924e8-28bc-4d7d-9133-18417d215d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:44.755913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:44.832933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 677/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:45.142739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac3597-923e-41e9-ba22-5002e2c89e80 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:45.144432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-bbac3597-923e-41e9-ba22-5002e2c89e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:45.301682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac3597-923e-41e9-ba22-5002e2c89e80 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:45.311887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:45.431174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:45.431796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:45.434880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:45.434880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:45.434880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:45.533775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:45.535703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a021-7d3f-403f-802e-a977891dbe5a service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:45.558773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 686/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:47.790094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bfaa0-cc25-427e-8de1-536ecfa9bcf3 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:47.790794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bfaa0-cc25-427e-8de1-536ecfa9bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:47.790794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bfaa0-cc25-427e-8de1-536ecfa9bcf3 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:47.792006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 678/1364] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:47.797302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932dc15-12cb-4862-918c-3abb601afac6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:47.798081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932dc15-12cb-4862-918c-3abb601afac6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:47.798359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932dc15-12cb-4862-918c-3abb601afac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:47.815808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:47.877739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f932dc15-12cb-4862-918c-3abb601afac6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:47.878725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f932dc15-12cb-4862-918c-3abb601afac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:47.980838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 687/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:48.274442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27415327-45e9-4c16-9cf2-bc458542547a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:48.274758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27415327-45e9-4c16-9cf2-bc458542547a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:48.275237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27415327-45e9-4c16-9cf2-bc458542547a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:48.276557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 679/1366] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 12 11:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:48.282624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb42925-162d-45b4-bffa-09feef651b8b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:48.283185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb42925-162d-45b4-bffa-09feef651b8b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:48.283565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb42925-162d-45b4-bffa-09feef651b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:48.362354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-aeb42925-162d-45b4-bffa-09feef651b8b None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:48.363738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-aeb42925-162d-45b4-bffa-09feef651b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:48.400586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:48.492864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 688/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 12 11:42:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:48.500672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27415327-45e9-4c16-9cf2-bc458542547a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:48.502334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-27415327-45e9-4c16-9cf2-bc458542547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:48.658954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27415327-45e9-4c16-9cf2-bc458542547a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:48.681469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:48.786438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:48.786988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:48.787271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:48.787549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:48.790042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:48.887636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:48.889240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e73bef-a485-463c-8c82-e12f3ccb36db service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:48.908444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 680/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:49.535896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96df4e-5d72-46cd-92e7-39ea9fc4b231 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:49.536526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96df4e-5d72-46cd-92e7-39ea9fc4b231 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:49.536526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96df4e-5d72-46cd-92e7-39ea9fc4b231 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:49.538466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 689/1369] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:49.543667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687a061-7f13-4062-bf8b-e685cddc5a7d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:49.543958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687a061-7f13-4062-bf8b-e685cddc5a7d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:49.544238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687a061-7f13-4062-bf8b-e685cddc5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:49.579503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:49.619254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8687a061-7f13-4062-bf8b-e685cddc5a7d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:49.620476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8687a061-7f13-4062-bf8b-e685cddc5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:49.723254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 681/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:42:50.329251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7932b8a-9a33-4fdf-aa0f-1a22e46048fa None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:50.329744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7932b8a-9a33-4fdf-aa0f-1a22e46048fa None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:50.330176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7932b8a-9a33-4fdf-aa0f-1a22e46048fa None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:50.331688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 690/1371] 10.222.0.42 () {54 vars in 964 bytes} [Fri Aug 12 11:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:50.337817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164cfdf-e7a0-4ccb-851a-f1f8f467e54d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:50.338258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164cfdf-e7a0-4ccb-851a-f1f8f467e54d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:50.338491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164cfdf-e7a0-4ccb-851a-f1f8f467e54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:50.422303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2164cfdf-e7a0-4ccb-851a-f1f8f467e54d None None] MFA Rules not processed for user `76127525ce2e45a3b53487d0f92014ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:50.423557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2164cfdf-e7a0-4ccb-851a-f1f8f467e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:50.472570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:50.504613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 682/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Aug 12 11:42:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:50.512542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7932b8a-9a33-4fdf-aa0f-1a22e46048fa None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:50.514055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e7932b8a-9a33-4fdf-aa0f-1a22e46048fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:50.626566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7932b8a-9a33-4fdf-aa0f-1a22e46048fa None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:50.676237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:50.714423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:50.715201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:50.715595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:50.715754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:50.717315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:50.835267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:50.836685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8bccd-6751-4d2b-bc09-dfc053930c17 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:50.866922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 691/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:50.882899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9771a-53a8-460e-af11-3f2e414fd10f None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:50.883191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9771a-53a8-460e-af11-3f2e414fd10f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:50.883462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9771a-53a8-460e-af11-3f2e414fd10f None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:50.884820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 683/1374] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:50.889823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340801-94a7-48da-9f90-43c53ad61e48 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:50.890099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340801-94a7-48da-9f90-43c53ad61e48 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:50.890374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340801-94a7-48da-9f90-43c53ad61e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:50.964069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-79340801-94a7-48da-9f90-43c53ad61e48 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:50.965583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-79340801-94a7-48da-9f90-43c53ad61e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:50.991611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:51.086725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 692/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:51.373097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9771a-53a8-460e-af11-3f2e414fd10f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:51.374629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-45c9771a-53a8-460e-af11-3f2e414fd10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:51.524776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9771a-53a8-460e-af11-3f2e414fd10f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:51.577733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:51.642663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:51.643306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:51.643584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:51.643857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:51.645452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:51.736377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:51.737949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970c7e7-7845-4b8f-94a8-97cc5e0b52cb service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:51.755905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 684/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:53.691002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14e8bd-8a07-4a34-b6d8-4edeb3d29b2e None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:53.691971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14e8bd-8a07-4a34-b6d8-4edeb3d29b2e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:53.692337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14e8bd-8a07-4a34-b6d8-4edeb3d29b2e None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:53.693860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 693/1377] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:53.699288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346fd96-c17e-49fd-aa0b-bf3c94d558c5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:53.699707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346fd96-c17e-49fd-aa0b-bf3c94d558c5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:53.699840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346fd96-c17e-49fd-aa0b-bf3c94d558c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:53.764977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e346fd96-c17e-49fd-aa0b-bf3c94d558c5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:53.766173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e346fd96-c17e-49fd-aa0b-bf3c94d558c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:53.773309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:53.884006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 685/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:42:54.173419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14e8bd-8a07-4a34-b6d8-4edeb3d29b2e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:54.175037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6c14e8bd-8a07-4a34-b6d8-4edeb3d29b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:54.346692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14e8bd-8a07-4a34-b6d8-4edeb3d29b2e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:54.352836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:54.495702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:54.496203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:54.496482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:54.496755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:54.498342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:54.592962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:54.594562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e5f-7d30-47a8-b18d-aaf9a82eebd1 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:54.613089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 694/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:56.572224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ccba-bc9a-4808-bc54-223268325bfc None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:56.572758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ccba-bc9a-4808-bc54-223268325bfc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:56.572758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ccba-bc9a-4808-bc54-223268325bfc None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:56.574108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 686/1380] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:42:56.579609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465855a-03da-41b4-bb6e-785c20016a74 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:56.580048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465855a-03da-41b4-bb6e-785c20016a74 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:56.580356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465855a-03da-41b4-bb6e-785c20016a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:56.592367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:56.649986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d465855a-03da-41b4-bb6e-785c20016a74 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:56.651206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d465855a-03da-41b4-bb6e-785c20016a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:56.754043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 695/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:42:57.043402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857ccba-bc9a-4808-bc54-223268325bfc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:42:57.045083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4857ccba-bc9a-4808-bc54-223268325bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:57.192328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:57.207243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857ccba-bc9a-4808-bc54-223268325bfc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:42:57.333369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:42:57.334093 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:57.334473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:57.334932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:57.336626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:57.439373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:42:57.441077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfba1d-24bd-4d5f-ab03-2a65f9cb5fcf service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:42:57.453721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:42:57.464024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 687/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:42:59.721556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95efd94-8dfa-46f9-8463-871020fed32b None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:59.722147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95efd94-8dfa-46f9-8463-871020fed32b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:59.722330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95efd94-8dfa-46f9-8463-871020fed32b None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:59.724132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 696/1383] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:42:59.731139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67a11-82b7-447d-839c-63afda769f80 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:42:59.731582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67a11-82b7-447d-839c-63afda769f80 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:42:59.731678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67a11-82b7-447d-839c-63afda769f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:42:59.798065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e1c67a11-82b7-447d-839c-63afda769f80 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:42:59.799299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e1c67a11-82b7-447d-839c-63afda769f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:42:59.896794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 688/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:00.190266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95efd94-8dfa-46f9-8463-871020fed32b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:00.192332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c95efd94-8dfa-46f9-8463-871020fed32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:00.299555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:00.362121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95efd94-8dfa-46f9-8463-871020fed32b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:00.481830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:00.482360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:00.482654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:00.482923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:00.484507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:00.540562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:00.590674 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:00.592268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6dcd5-7bd2-4d8d-ad48-ded33fb2dc44 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:00.611170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 697/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:02.796788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402aa3-5c8d-42ec-b2ab-b0b113eec375 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:02.797458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402aa3-5c8d-42ec-b2ab-b0b113eec375 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:02.797458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402aa3-5c8d-42ec-b2ab-b0b113eec375 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:02.798710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 689/1386] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:02.805838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11009004-60c1-4b6d-8aaf-2053ab0f9ca4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:02.806280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11009004-60c1-4b6d-8aaf-2053ab0f9ca4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:02.806389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11009004-60c1-4b6d-8aaf-2053ab0f9ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:02.874452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-11009004-60c1-4b6d-8aaf-2053ab0f9ca4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:02.876007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-11009004-60c1-4b6d-8aaf-2053ab0f9ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:02.973017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 698/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:03.261949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402aa3-5c8d-42ec-b2ab-b0b113eec375 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:03.264014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ed402aa3-5c8d-42ec-b2ab-b0b113eec375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:03.351703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:03.425859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402aa3-5c8d-42ec-b2ab-b0b113eec375 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:03.567703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:03.568494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:03.568903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:03.569313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:03.571441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:03.610958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:03.669090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:03.670736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e4ada-828a-4cd5-95ab-5405f30dff16 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:03.689295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 690/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:43:05.620493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bab1-0c7a-446b-951e-5f7c120922b5 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:05.621093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bab1-0c7a-446b-951e-5f7c120922b5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:05.621093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bab1-0c7a-446b-951e-5f7c120922b5 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:05.622382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 699/1389] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:05.627616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cceca-4a1a-4528-aa29-21a115649da4 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:05.628100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cceca-4a1a-4528-aa29-21a115649da4 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:05.628275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cceca-4a1a-4528-aa29-21a115649da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:05.694338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-383cceca-4a1a-4528-aa29-21a115649da4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:05.695605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-383cceca-4a1a-4528-aa29-21a115649da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:05.794047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 691/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:43:06.078555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bab1-0c7a-446b-951e-5f7c120922b5 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:06.080172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9273bab1-0c7a-446b-951e-5f7c120922b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:06.111616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:06.176074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d03c4-739d-4046-bb2b-2aa0e691022a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:06.176278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d03c4-739d-4046-bb2b-2aa0e691022a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:06.176530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d03c4-739d-4046-bb2b-2aa0e691022a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:06.177874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 692/1391] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:43:06.183378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee54ef-46cd-4bb2-a069-06e8c46f136b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:06.183664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee54ef-46cd-4bb2-a069-06e8c46f136b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:06.183944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee54ef-46cd-4bb2-a069-06e8c46f136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:06.199516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:06.226577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bab1-0c7a-446b-951e-5f7c120922b5 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:06.250694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b0ee54ef-46cd-4bb2-a069-06e8c46f136b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:06.251923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b0ee54ef-46cd-4bb2-a069-06e8c46f136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:06.332359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:06.344938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:06.345546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:06.345822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:06.346088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:06.347701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:06.348721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 693/1392] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:43:06.436578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:06.438099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9451d-34b4-4ef6-b76a-34ffba103354 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:06.455955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 700/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:06.654924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87469bd8-8a75-4508-ae94-7728eb354d54 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:06.656376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87469bd8-8a75-4508-ae94-7728eb354d54 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:06.656376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87469bd8-8a75-4508-ae94-7728eb354d54 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:06.656809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 694/1394] 10.222.0.42 () {54 vars in 967 bytes} [Fri Aug 12 11:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:06.661842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423a3c4-34da-41b2-b1d4-e20599cbbfd1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:06.662296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423a3c4-34da-41b2-b1d4-e20599cbbfd1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:06.662523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423a3c4-34da-41b2-b1d4-e20599cbbfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:06.738105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3423a3c4-34da-41b2-b1d4-e20599cbbfd1 None None] MFA Rules not processed for user `a1335a28b21342d1afed40e182a524f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:06.739328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3423a3c4-34da-41b2-b1d4-e20599cbbfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:06.791835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:06.815456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 701/1395] 10.222.0.42 () {58 vars in 1064 bytes} [Fri Aug 12 11:43:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:43:06.823499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87469bd8-8a75-4508-ae94-7728eb354d54 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:06.825051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-87469bd8-8a75-4508-ae94-7728eb354d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:06.924995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:06.932452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87469bd8-8a75-4508-ae94-7728eb354d54 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:07.008158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:07.008674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:07.008949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:07.009218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:07.010816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:07.119231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:07.120667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4459-1154-4846-819a-3662a8222b7b service glance] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:07.138854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 695/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:07.900789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007add7-a631-469f-bce9-c4ae6588eb65 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:07.901277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007add7-a631-469f-bce9-c4ae6588eb65 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:07.901402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007add7-a631-469f-bce9-c4ae6588eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:07.967633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f007add7-a631-469f-bce9-c4ae6588eb65 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:07.968816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f007add7-a631-469f-bce9-c4ae6588eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:08.053739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 702/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:43:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:08.097210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09480f-1e5b-4ff9-a25f-4ca19741b4cc None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:08.097696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09480f-1e5b-4ff9-a25f-4ca19741b4cc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:08.097798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09480f-1e5b-4ff9-a25f-4ca19741b4cc None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:08.099192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 696/1398] 10.222.0.42 () {54 vars in 943 bytes} [Fri Aug 12 11:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:08.106026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bc63-bf85-4bdd-8ca4-3624f503a8e7 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:08.106377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bc63-bf85-4bdd-8ca4-3624f503a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:08.106759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bc63-bf85-4bdd-8ca4-3624f503a8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:08.190273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0935bc63-bf85-4bdd-8ca4-3624f503a8e7 None None] MFA Rules not processed for user `64379c68ad5d4aa989691e3dcbdb1900`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:08.191421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0935bc63-bf85-4bdd-8ca4-3624f503a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:08.204637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:08.298423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 703/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Fri Aug 12 11:43:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:08.307743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09480f-1e5b-4ff9-a25f-4ca19741b4cc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:08.309258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ed09480f-1e5b-4ff9-a25f-4ca19741b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:08.332955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:08.401451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463401-d387-4f3f-be05-6aabb2347068 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:08.401734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463401-d387-4f3f-be05-6aabb2347068 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:08.402012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463401-d387-4f3f-be05-6aabb2347068 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:08.403407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 704/1400] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:43:08.408410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:08.408692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:08.408963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:08.457166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09480f-1e5b-4ff9-a25f-4ca19741b4cc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:08.477379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:08.478573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:08.555060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:08.566032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:08.566662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:08.566942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:08.567229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:08.569483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:08.576990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:08.579441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 705/1401] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:43:08.652992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:08.654573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfd4d6-7777-4445-9ed4-212d0b03bed9 service swift] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:08.662739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 697/1402] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:43:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:43:08.881639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:08.882920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:09.002684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83f217-d0e5-4d5e-82ce-9f35998eec66 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:09.128597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:09.158096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:09.158736 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:09.159012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:09.159282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:09.161994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:09.267426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:09.268946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bf06a-23a4-4722-a559-1395a3f3c1b7 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:09.293029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 706/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:11.285399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66992c8-a816-4be1-a102-e621103ff0d1 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:11.285950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66992c8-a816-4be1-a102-e621103ff0d1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:11.285950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66992c8-a816-4be1-a102-e621103ff0d1 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:11.288161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 698/1404] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:11.293346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c96b-eeb1-417b-8d16-f2f369bf3c33 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:11.293788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c96b-eeb1-417b-8d16-f2f369bf3c33 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:11.293894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c96b-eeb1-417b-8d16-f2f369bf3c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:11.369884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8da4c96b-eeb1-417b-8d16-f2f369bf3c33 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:11.372028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8da4c96b-eeb1-417b-8d16-f2f369bf3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:11.431856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:11.494131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 707/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:11.779860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66992c8-a816-4be1-a102-e621103ff0d1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:11.781393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b66992c8-a816-4be1-a102-e621103ff0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:11.956956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66992c8-a816-4be1-a102-e621103ff0d1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:11.960524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:12.104154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:12.104759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:12.105037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:12.105319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:12.106944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:12.213035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:12.214663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dea805-74c5-4388-bb18-08ecec10086e service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:12.236234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 699/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:14.170369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c9a9-f1cd-4f18-ac65-a4cc1d22e354 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:14.170962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c9a9-f1cd-4f18-ac65-a4cc1d22e354 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:14.170962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c9a9-f1cd-4f18-ac65-a4cc1d22e354 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:14.172344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 708/1407] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:14.178518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f447-4a2f-48dd-b5e3-1634de273db2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:14.179037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f447-4a2f-48dd-b5e3-1634de273db2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:14.179136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f447-4a2f-48dd-b5e3-1634de273db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:14.189082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:14.254266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-be44f447-4a2f-48dd-b5e3-1634de273db2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:14.256230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-be44f447-4a2f-48dd-b5e3-1634de273db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:14.367758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 700/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:14.660419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c9a9-f1cd-4f18-ac65-a4cc1d22e354 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:14.662691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b7c8c9a9-f1cd-4f18-ac65-a4cc1d22e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:14.834666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c9a9-f1cd-4f18-ac65-a4cc1d22e354 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:14.922154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:15.022362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:15.023031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:15.023313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:15.023585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:15.025192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:15.126947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:15.128544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534a5cd-be3e-49b0-878c-3b93fe3fd147 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:15.148178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 709/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:24.365819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=62 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:25.146037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=82 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:30.636249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77187-b64d-4495-b971-fbb2e6321e36 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:30.636844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77187-b64d-4495-b971-fbb2e6321e36 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:30.636844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77187-b64d-4495-b971-fbb2e6321e36 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:30.638143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 701/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Aug 12 11:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:30.643210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc759-aaed-476e-8949-91536c4b6efe None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:30.643631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc759-aaed-476e-8949-91536c4b6efe None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:30.643764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc759-aaed-476e-8949-91536c4b6efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:30.717803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-456dc759-aaed-476e-8949-91536c4b6efe None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:30.719034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-456dc759-aaed-476e-8949-91536c4b6efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:30.823981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 710/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 12 11:43:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:30.838473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c7a6-bd57-4534-8e54-3927619b61a7 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:30.838793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c7a6-bd57-4534-8e54-3927619b61a7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:30.839069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c7a6-bd57-4534-8e54-3927619b61a7 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:30.840391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 702/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Aug 12 11:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:30.844891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2403203-2cb6-4e49-81f8-ab88ca49baa3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:30.845186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2403203-2cb6-4e49-81f8-ab88ca49baa3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:30.845466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2403203-2cb6-4e49-81f8-ab88ca49baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:30.916604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:30.919526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a2403203-2cb6-4e49-81f8-ab88ca49baa3 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:30.921208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a2403203-2cb6-4e49-81f8-ab88ca49baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:31.036368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 711/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 12 11:43:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:33.398813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df38b-1dd5-43e5-99cc-cd906d8eb7bb None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:33.399303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df38b-1dd5-43e5-99cc-cd906d8eb7bb None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:33.399401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df38b-1dd5-43e5-99cc-cd906d8eb7bb None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:33.400696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:33.406044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581f83-3000-427f-b03d-fb123ab08991 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:33.406469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581f83-3000-427f-b03d-fb123ab08991 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:33.406660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581f83-3000-427f-b03d-fb123ab08991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:33.471494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4c581f83-3000-427f-b03d-fb123ab08991 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:33.472704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4c581f83-3000-427f-b03d-fb123ab08991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:33.527777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:33.571610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:33.855811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732df38b-1dd5-43e5-99cc-cd906d8eb7bb None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:33.857564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-732df38b-1dd5-43e5-99cc-cd906d8eb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:34.002949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732df38b-1dd5-43e5-99cc-cd906d8eb7bb None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:34.075206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:34.115104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:34.115714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:34.115992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:34.116264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:34.117876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:34.204470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:34.206039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a13953-7a52-4e3c-a71f-02d411f59b4b service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:34.223525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 704/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:35.109680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7853-e99f-4b61-953e-703619195ee7 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:35.110212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7853-e99f-4b61-953e-703619195ee7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:35.110332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7853-e99f-4b61-953e-703619195ee7 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:35.111637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:35.116998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d2d4b-6423-4eac-a2f1-bf0d94d60af5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:35.117445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d2d4b-6423-4eac-a2f1-bf0d94d60af5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:35.117549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d2d4b-6423-4eac-a2f1-bf0d94d60af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:35.193328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-708d2d4b-6423-4eac-a2f1-bf0d94d60af5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:35.194449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-708d2d4b-6423-4eac-a2f1-bf0d94d60af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:35.220899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:35.288360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:35.440147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced7853-e99f-4b61-953e-703619195ee7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:35.441743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8ced7853-e99f-4b61-953e-703619195ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:35.583987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced7853-e99f-4b61-953e-703619195ee7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:35.625513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:35.698977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:35.699584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:35.699864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:35.700138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:35.701728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:35.790106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:35.791739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9954aea-9680-42ff-82ec-afe17664a767 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:35.809336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 714/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:36.690163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d37d-a4b2-4573-86df-2b403ff87f5a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:36.690743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d37d-a4b2-4573-86df-2b403ff87f5a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:36.690743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d37d-a4b2-4573-86df-2b403ff87f5a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:36.692068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:36.696919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f21fc-d3a1-491f-bee9-032b3c2ed016 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:36.697366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f21fc-d3a1-491f-bee9-032b3c2ed016 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:36.697458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f21fc-d3a1-491f-bee9-032b3c2ed016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:36.750555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:36.772009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ad6f21fc-d3a1-491f-bee9-032b3c2ed016 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:36.773207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ad6f21fc-d3a1-491f-bee9-032b3c2ed016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:36.868218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:37.019232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6d37d-a4b2-4573-86df-2b403ff87f5a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:37.020716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-18d6d37d-a4b2-4573-86df-2b403ff87f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:37.164452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6d37d-a4b2-4573-86df-2b403ff87f5a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:37.176727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:37.275879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:37.276401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:37.276682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:37.276954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:37.278554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:37.364932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:37.366504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1c25-354e-4a77-ae3c-681e809496f8 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:37.384471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 707/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:38.251508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6821fb-a50a-44ab-a565-779cb46970cb None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.252019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6821fb-a50a-44ab-a565-779cb46970cb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.252019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6821fb-a50a-44ab-a565-779cb46970cb None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.253324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:38.258824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1e2b-b05a-4c17-aff6-bb61a8b0772f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.259277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1e2b-b05a-4c17-aff6-bb61a8b0772f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.259386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1e2b-b05a-4c17-aff6-bb61a8b0772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.279078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:38.336732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-749f1e2b-b05a-4c17-aff6-bb61a8b0772f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:38.337938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-749f1e2b-b05a-4c17-aff6-bb61a8b0772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:38.431072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:38.580846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6821fb-a50a-44ab-a565-779cb46970cb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:38.582921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2b6821fb-a50a-44ab-a565-779cb46970cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:38.689273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:38.725486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6821fb-a50a-44ab-a565-779cb46970cb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:38.840160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:38.840679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.840953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.841217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.842829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:38.922429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:38.936528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:38.938126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecdc2c-8061-4ad6-880d-85a213749f33 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:38.955658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 717/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:39.844247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e04c7-9c82-477e-99b8-38730615e8ef None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.844800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e04c7-9c82-477e-99b8-38730615e8ef None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.844800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e04c7-9c82-477e-99b8-38730615e8ef None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.846127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:39.851299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf28e13-b806-4cce-8223-c57925a556b2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.851734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf28e13-b806-4cce-8223-c57925a556b2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.851854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf28e13-b806-4cce-8223-c57925a556b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.926854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cdf28e13-b806-4cce-8223-c57925a556b2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:39.927997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cdf28e13-b806-4cce-8223-c57925a556b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:40.022079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:40.173055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e04c7-9c82-477e-99b8-38730615e8ef None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:40.174653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-205e04c7-9c82-477e-99b8-38730615e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:40.256836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:40.319571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e04c7-9c82-477e-99b8-38730615e8ef None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:40.429308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:40.429913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:40.430195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:40.430469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:40.432111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:40.482536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:40.523577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:40.525092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9a55-d833-40a7-b0c4-4f582367e6ef service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:40.542903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 710/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:41.359237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae2ada-1980-444c-a570-5e6b058b6591 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:41.359794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae2ada-1980-444c-a570-5e6b058b6591 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:41.359794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae2ada-1980-444c-a570-5e6b058b6591 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:41.361160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:41.366531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ea46-e5b6-4b35-a033-dad1f48f5da4 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:41.366999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ea46-e5b6-4b35-a033-dad1f48f5da4 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:41.367102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ea46-e5b6-4b35-a033-dad1f48f5da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:41.442720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e9d0ea46-e5b6-4b35-a033-dad1f48f5da4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:41.443934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e9d0ea46-e5b6-4b35-a033-dad1f48f5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:41.537604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:41.684807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae2ada-1980-444c-a570-5e6b058b6591 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:41.686353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-00ae2ada-1980-444c-a570-5e6b058b6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:41.733905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:41.828787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae2ada-1980-444c-a570-5e6b058b6591 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:41.949489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:41.950103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:41.950382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:41.950683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:41.952281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:41.959121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:42.041441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:42.043086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8607d9-c4b0-4b44-88b9-deca578f0924 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:42.064084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 720/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:42.861705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0553-36b5-4a1f-b385-6d09923fb4d6 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.862253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0553-36b5-4a1f-b385-6d09923fb4d6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.862253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0553-36b5-4a1f-b385-6d09923fb4d6 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.863716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:42.868676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa84b5-1fce-4b7e-9ffe-2a97a5d3eb54 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.869123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa84b5-1fce-4b7e-9ffe-2a97a5d3eb54 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.869311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa84b5-1fce-4b7e-9ffe-2a97a5d3eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.943850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fdaa84b5-1fce-4b7e-9ffe-2a97a5d3eb54 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:42.945063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fdaa84b5-1fce-4b7e-9ffe-2a97a5d3eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:43.010748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.040027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:43.189369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa0553-36b5-4a1f-b385-6d09923fb4d6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:43.191467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b2fa0553-36b5-4a1f-b385-6d09923fb4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:43.208694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.339226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa0553-36b5-4a1f-b385-6d09923fb4d6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.423396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.449671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.450206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.450481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.450779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.452383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:43.538706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.540280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaddbf-67a4-4aa3-a910-78876187da53 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.557886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 713/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:44.356170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de7b2-0beb-41d2-9810-4c67df29f8ab None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.356703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de7b2-0beb-41d2-9810-4c67df29f8ab None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.356703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de7b2-0beb-41d2-9810-4c67df29f8ab None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.358062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:44.363179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed420e-357c-4cf7-908e-35a9929601e7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.363616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed420e-357c-4cf7-908e-35a9929601e7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.363723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed420e-357c-4cf7-908e-35a9929601e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.438494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-33ed420e-357c-4cf7-908e-35a9929601e7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:44.439657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-33ed420e-357c-4cf7-908e-35a9929601e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:44.480977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:44.534930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:44.686113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de7b2-0beb-41d2-9810-4c67df29f8ab None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:44.687672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-725de7b2-0beb-41d2-9810-4c67df29f8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:44.833201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de7b2-0beb-41d2-9810-4c67df29f8ab None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.886178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:44.947019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.947628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.947904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.948173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.949789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:45.037406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:45.038964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b1d27-c655-459d-9fd2-1fe9f74cb583 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:45.056435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 723/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:45.913216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c25d-334b-4cc5-ac45-14deec192594 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:45.913720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c25d-334b-4cc5-ac45-14deec192594 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:45.913720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c25d-334b-4cc5-ac45-14deec192594 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:45.915132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:45.920009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c704c-0249-45d5-8791-98b3cc692991 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:45.920438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c704c-0249-45d5-8791-98b3cc692991 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:45.920557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c704c-0249-45d5-8791-98b3cc692991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:45.995819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-773c704c-0249-45d5-8791-98b3cc692991 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:45.997042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-773c704c-0249-45d5-8791-98b3cc692991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:45.999064 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:46.096867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:46.244548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c25d-334b-4cc5-ac45-14deec192594 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:46.246015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0720c25d-334b-4cc5-ac45-14deec192594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:46.389775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c25d-334b-4cc5-ac45-14deec192594 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:46.415389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:46.499635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:46.500159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.500433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.500700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.502272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:46.587160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:46.588731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d924e1-1fc5-48b3-9959-0922dd6417f1 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:46.606493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 716/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:48.423853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebe039-999c-422c-90d5-cf07f2a37700 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:48.424411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebe039-999c-422c-90d5-cf07f2a37700 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:48.424411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebe039-999c-422c-90d5-cf07f2a37700 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:48.425768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:48.431530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149da1-ac87-4472-bfdb-765e7e5225d3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:48.431964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149da1-ac87-4472-bfdb-765e7e5225d3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:48.432090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149da1-ac87-4472-bfdb-765e7e5225d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:48.473436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:48.497754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d5149da1-ac87-4472-bfdb-765e7e5225d3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:48.498975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d5149da1-ac87-4472-bfdb-765e7e5225d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:48.594773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:48.877505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebe039-999c-422c-90d5-cf07f2a37700 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:48.879608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ccebe039-999c-422c-90d5-cf07f2a37700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:48.980998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebe039-999c-422c-90d5-cf07f2a37700 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:49.012765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:49.054858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:49.055464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:49.055744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:49.056019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:49.057615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:49.164396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:49.165759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e48f-3d86-4459-b7f4-ae7c91066d83 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:49.183874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 726/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:51.232561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446fa0-8680-4dd3-9f5e-48cd79abe7ba None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:51.233108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446fa0-8680-4dd3-9f5e-48cd79abe7ba None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:51.233108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446fa0-8680-4dd3-9f5e-48cd79abe7ba None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:51.234440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:51.239650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf66fe-186b-482f-983c-7431774d8939 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:51.240096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf66fe-186b-482f-983c-7431774d8939 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:51.240203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf66fe-186b-482f-983c-7431774d8939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:51.304468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-dfaf66fe-186b-482f-983c-7431774d8939 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:51.305663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-dfaf66fe-186b-482f-983c-7431774d8939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:51.318885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:51.399476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:51.683269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d446fa0-8680-4dd3-9f5e-48cd79abe7ba None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:51.684799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5d446fa0-8680-4dd3-9f5e-48cd79abe7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:51.784959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d446fa0-8680-4dd3-9f5e-48cd79abe7ba None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:51.796970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:51.857375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:51.857976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:51.858252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:51.858522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:51.860152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:51.966874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:51.968640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf3d78-13d7-4066-b2d0-3e5180f1c11e service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:51.986726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 719/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:54.207169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5d6a1-1760-42ea-ad2f-fd36ae027a37 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.207754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5d6a1-1760-42ea-ad2f-fd36ae027a37 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.207754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5d6a1-1760-42ea-ad2f-fd36ae027a37 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.209067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:54.214182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae8b9e-683a-4aeb-8d4d-f6fb164dbe97 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.214584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae8b9e-683a-4aeb-8d4d-f6fb164dbe97 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.214772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae8b9e-683a-4aeb-8d4d-f6fb164dbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.265213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.283593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2bae8b9e-683a-4aeb-8d4d-f6fb164dbe97 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:54.285440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2bae8b9e-683a-4aeb-8d4d-f6fb164dbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:54.383244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:43:54.663468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5d6a1-1760-42ea-ad2f-fd36ae027a37 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.664992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b1c5d6a1-1760-42ea-ad2f-fd36ae027a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:54.764873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5d6a1-1760-42ea-ad2f-fd36ae027a37 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.805243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.839175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.839815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.840096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.840379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.841996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:54.954263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.955683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6fad7-99d4-4456-844b-5a012dff7296 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.973948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 729/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:43:56.981123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae779-dba6-4f4f-8038-aecaa9a39693 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.981651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae779-dba6-4f4f-8038-aecaa9a39693 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.981764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae779-dba6-4f4f-8038-aecaa9a39693 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.983052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:56.988729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58852f-64c1-46dc-b90a-28dc08d219c2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.989154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58852f-64c1-46dc-b90a-28dc08d219c2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.989306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58852f-64c1-46dc-b90a-28dc08d219c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:57.175431 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8d58852f-64c1-46dc-b90a-28dc08d219c2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:57.176544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8d58852f-64c1-46dc-b90a-28dc08d219c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:57.197612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:57.272321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:43:57.554062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae779-dba6-4f4f-8038-aecaa9a39693 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:57.555650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a9bae779-dba6-4f4f-8038-aecaa9a39693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:57.656951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae779-dba6-4f4f-8038-aecaa9a39693 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:57.677634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:57.730098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:57.730720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:57.731000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:57.731266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:57.732843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:57.839645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:57.841031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92763ea8-4fc8-4f7c-982b-6c9b996eee74 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:57.862748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 722/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:43:59.814178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e658ea-9944-4a4d-9ac1-b5a8ae92b48f None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.815376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e658ea-9944-4a4d-9ac1-b5a8ae92b48f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.815376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e658ea-9944-4a4d-9ac1-b5a8ae92b48f None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.816643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:59.821810 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71484d-1b7d-4e0d-bc81-16e674e99367 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.822205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71484d-1b7d-4e0d-bc81-16e674e99367 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.822362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71484d-1b7d-4e0d-bc81-16e674e99367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.885193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:59.888163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8c71484d-1b7d-4e0d-bc81-16e674e99367 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:59.890008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8c71484d-1b7d-4e0d-bc81-16e674e99367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:59.985617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:00.272861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e658ea-9944-4a4d-9ac1-b5a8ae92b48f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.274391 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-04e658ea-9944-4a4d-9ac1-b5a8ae92b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:00.374764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e658ea-9944-4a4d-9ac1-b5a8ae92b48f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.425424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:00.449854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.450451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.450755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.451025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.452603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:00.556272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:00.557985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32333236-0550-4ec2-9ee6-b2589d647eed service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:00.578478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 732/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:02.518924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d704-1a56-4a1a-83aa-1b2ec9e60fd7 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.519497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d704-1a56-4a1a-83aa-1b2ec9e60fd7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.519497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d704-1a56-4a1a-83aa-1b2ec9e60fd7 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.521139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:02.526376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62412-0600-42cc-8acd-06614811ff10 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.526905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62412-0600-42cc-8acd-06614811ff10 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.527014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62412-0600-42cc-8acd-06614811ff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.593381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-bba62412-0600-42cc-8acd-06614811ff10 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:02.594575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-bba62412-0600-42cc-8acd-06614811ff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:02.622600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:02.688184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:02.972183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d704-1a56-4a1a-83aa-1b2ec9e60fd7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:02.973723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c819d704-1a56-4a1a-83aa-1b2ec9e60fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:03.075000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d704-1a56-4a1a-83aa-1b2ec9e60fd7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:03.103523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:03.147781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:03.148314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:03.148590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:03.148859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:03.150459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:03.263832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:03.265246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ffbd-a54e-4d03-a0a4-0fb1c82962b4 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:03.284518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 725/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:05.210087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b764a1-012f-4c6f-a584-a02dd1328c58 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.210649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b764a1-012f-4c6f-a584-a02dd1328c58 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.210649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b764a1-012f-4c6f-a584-a02dd1328c58 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.211930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:05.217062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234001a-ed35-4488-bef5-fc55753b8063 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.217512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234001a-ed35-4488-bef5-fc55753b8063 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.217612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234001a-ed35-4488-bef5-fc55753b8063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.280828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5234001a-ed35-4488-bef5-fc55753b8063 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:05.282025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5234001a-ed35-4488-bef5-fc55753b8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:05.290063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:05.377458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:05.657180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b764a1-012f-4c6f-a584-a02dd1328c58 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.658800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-64b764a1-012f-4c6f-a584-a02dd1328c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:05.759364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b764a1-012f-4c6f-a584-a02dd1328c58 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:05.811730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:05.830212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:05.830837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.831113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.831380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.832956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:05.941088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:05.942453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f4b9d-1a4b-4931-bf5d-ea58ff317121 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:05.959870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 735/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:07.906933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19fe6-260b-40fe-8ea0-f741db6ead7d None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.907442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19fe6-260b-40fe-8ea0-f741db6ead7d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.907548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19fe6-260b-40fe-8ea0-f741db6ead7d None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.908875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:07.914121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f035-04bc-43a6-ae00-4c322f6412fc None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.914510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f035-04bc-43a6-ae00-4c322f6412fc None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.914714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f035-04bc-43a6-ae00-4c322f6412fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.980181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7ac7f035-04bc-43a6-ae00-4c322f6412fc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:07.981315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7ac7f035-04bc-43a6-ae00-4c322f6412fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:08.019898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.077542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:08.376961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c19fe6-260b-40fe-8ea0-f741db6ead7d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.378524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-94c19fe6-260b-40fe-8ea0-f741db6ead7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:08.482088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c19fe6-260b-40fe-8ea0-f741db6ead7d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.518973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.553969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.554567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.554876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.555154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.556730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:08.672818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.674237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23b170-4eeb-4835-81f3-da58a1586aad service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.693723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 728/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:10.592847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f0c1-fecb-4480-be2b-39834625a139 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:10.593405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f0c1-fecb-4480-be2b-39834625a139 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:10.593405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f0c1-fecb-4480-be2b-39834625a139 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:10.594749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:10.600337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef47c8b-bbff-4fe1-b95c-c713763df879 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:10.600762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef47c8b-bbff-4fe1-b95c-c713763df879 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:10.600876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef47c8b-bbff-4fe1-b95c-c713763df879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:10.664552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-7ef47c8b-bbff-4fe1-b95c-c713763df879 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:10.665733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7ef47c8b-bbff-4fe1-b95c-c713763df879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:10.684282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:10.762172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:11.041151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f0c1-fecb-4480-be2b-39834625a139 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:11.042745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a3a4f0c1-fecb-4480-be2b-39834625a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:11.143896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f0c1-fecb-4480-be2b-39834625a139 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:11.212378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:11.219105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:11.219709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.219986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.220280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.221954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:11.327853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:11.329287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3431aef-210b-4738-a0d8-eb198ee4869f service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:11.347236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 738/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:13.243529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee9cec-0763-41d4-96d0-be15f70c9894 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.244071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee9cec-0763-41d4-96d0-be15f70c9894 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.244071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee9cec-0763-41d4-96d0-be15f70c9894 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.245319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:13.250450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8009e0-841e-49ac-9e92-ae2b160901c4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.250901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8009e0-841e-49ac-9e92-ae2b160901c4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.251065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8009e0-841e-49ac-9e92-ae2b160901c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.322521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0b8009e0-841e-49ac-9e92-ae2b160901c4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:13.323743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0b8009e0-841e-49ac-9e92-ae2b160901c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:13.370977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:13.418038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:13.699471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee9cec-0763-41d4-96d0-be15f70c9894 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.701041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-feee9cec-0763-41d4-96d0-be15f70c9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:13.802426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee9cec-0763-41d4-96d0-be15f70c9894 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.849243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:13.875057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.875417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.875693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.875962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.877569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:13.984426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:13.985809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25820-93e2-4413-9d21-f9ae0b91fc47 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:14.003730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 731/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:23.416250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=22 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:24.001606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=66 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.286207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a9a9c-4895-48cf-b720-2ac0f923df16 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.286863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a9a9c-4895-48cf-b720-2ac0f923df16 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.286863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a9a9c-4895-48cf-b720-2ac0f923df16 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.288124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 740/1471] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:33.293500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d69f4-6ea8-42d9-90cd-35cf8af699df None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.293911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d69f4-6ea8-42d9-90cd-35cf8af699df None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.294050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d69f4-6ea8-42d9-90cd-35cf8af699df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.360143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-251d69f4-6ea8-42d9-90cd-35cf8af699df None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:33.361342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-251d69f4-6ea8-42d9-90cd-35cf8af699df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:33.454636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 732/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:33.760464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d263-753f-4e91-a07f-b3ef30502336 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.760833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d263-753f-4e91-a07f-b3ef30502336 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.761111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d263-753f-4e91-a07f-b3ef30502336 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.762426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 741/1473] 10.222.0.42 () {54 vars in 967 bytes} [Fri Aug 12 11:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:33.767074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d533e-fdf0-4f23-b681-c94e6e78f1fd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.767366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d533e-fdf0-4f23-b681-c94e6e78f1fd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.767659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d533e-fdf0-4f23-b681-c94e6e78f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.841752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f08d533e-fdf0-4f23-b681-c94e6e78f1fd None None] MFA Rules not processed for user `a1335a28b21342d1afed40e182a524f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:33.842976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f08d533e-fdf0-4f23-b681-c94e6e78f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:33.863904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.920350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 733/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Fri Aug 12 11:44:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:33.928467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6d263-753f-4e91-a07f-b3ef30502336 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.930244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cfb6d263-753f-4e91-a07f-b3ef30502336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:34.033555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6d263-753f-4e91-a07f-b3ef30502336 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:34.105226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:34.105824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.106100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.106367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.107971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:34.160534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:34.214249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:34.215713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f742f7-0756-45de-be41-fbc88d428780 service glance] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:34.233999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 742/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:36.203977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac0e4c-1097-46d4-bf51-4508490e3e08 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.204556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac0e4c-1097-46d4-bf51-4508490e3e08 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.204556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac0e4c-1097-46d4-bf51-4508490e3e08 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.205880 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 734/1476] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:36.211013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0c8c6-0ab0-4432-bfe7-89089972c00a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.211478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0c8c6-0ab0-4432-bfe7-89089972c00a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.211591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0c8c6-0ab0-4432-bfe7-89089972c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.276156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c6a0c8c6-0ab0-4432-bfe7-89089972c00a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:36.277344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c6a0c8c6-0ab0-4432-bfe7-89089972c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:36.369911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 743/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:36.647993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac0e4c-1097-46d4-bf51-4508490e3e08 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.649549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9bac0e4c-1097-46d4-bf51-4508490e3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:36.771984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac0e4c-1097-46d4-bf51-4508490e3e08 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:36.819967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:36.866205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:36.866841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.867122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.867393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.868025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:36.869758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:44:36.869758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:44:36.869758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:44:36.870933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b3584-0065-413a-8089-9c925a053d63 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:36.889579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 735/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:44:38.781695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea5532-3ce3-491b-b91f-d440d2ffc4bf None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.782236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea5532-3ce3-491b-b91f-d440d2ffc4bf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.782236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea5532-3ce3-491b-b91f-d440d2ffc4bf None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.783624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 744/1479] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:38.788781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5934f70-e1c9-4e26-8c50-eeb0512f25bf None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.789214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5934f70-e1c9-4e26-8c50-eeb0512f25bf None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.789320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5934f70-e1c9-4e26-8c50-eeb0512f25bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.854256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b5934f70-e1c9-4e26-8c50-eeb0512f25bf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:38.855476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b5934f70-e1c9-4e26-8c50-eeb0512f25bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:38.955510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 736/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:39.246682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea5532-3ce3-491b-b91f-d440d2ffc4bf None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.248248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a9ea5532-3ce3-491b-b91f-d440d2ffc4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:39.258584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.400193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea5532-3ce3-491b-b91f-d440d2ffc4bf None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.478106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.511049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.511591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.511869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.512143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.513741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:39.600643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:39.602227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e8231-b61e-4550-876e-495560d67618 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:39.620037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 745/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:41.696065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188feff-0207-469b-812a-838ff933ab85 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.696462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188feff-0207-469b-812a-838ff933ab85 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.696618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188feff-0207-469b-812a-838ff933ab85 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.697962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 737/1482] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:41.703087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd38c-deed-44d0-87eb-0e23d7d82a23 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.703507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd38c-deed-44d0-87eb-0e23d7d82a23 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.703642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd38c-deed-44d0-87eb-0e23d7d82a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.768957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a1efd38c-deed-44d0-87eb-0e23d7d82a23 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:41.770148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a1efd38c-deed-44d0-87eb-0e23d7d82a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:41.815344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.864337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 746/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:42.150982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188feff-0207-469b-812a-838ff933ab85 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:42.152526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5188feff-0207-469b-812a-838ff933ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:42.176032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:42.255504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188feff-0207-469b-812a-838ff933ab85 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:42.328410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:42.329013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:42.329298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:42.329569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:42.331197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:42.402071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:42.436038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:42.438049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ca97e-a436-4a52-b4b7-1e279109fb71 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:42.457220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 738/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:44.387338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144571-ddea-4cf7-a299-8cdf8a726236 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:44.387910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144571-ddea-4cf7-a299-8cdf8a726236 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:44.387910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144571-ddea-4cf7-a299-8cdf8a726236 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:44.389242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 747/1485] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:44.394308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34448af-1281-445a-b216-25183afbca9a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:44.394819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34448af-1281-445a-b216-25183afbca9a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:44.394921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34448af-1281-445a-b216-25183afbca9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:44.458515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e34448af-1281-445a-b216-25183afbca9a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:44.459681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e34448af-1281-445a-b216-25183afbca9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:44.553701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 739/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:44:44.843965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144571-ddea-4cf7-a299-8cdf8a726236 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:44.845568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8b144571-ddea-4cf7-a299-8cdf8a726236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:44.948888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144571-ddea-4cf7-a299-8cdf8a726236 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:45.019776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:45.022660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:45.023444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.023926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.024394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.025983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:45.132530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:45.133953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee87219-01b2-4ffb-9cf1-fe025458a6c0 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:45.151507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 748/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:47.275094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fd0c-f126-4dbf-84c8-5170ae85c336 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.275681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fd0c-f126-4dbf-84c8-5170ae85c336 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.275681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fd0c-f126-4dbf-84c8-5170ae85c336 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.277889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 740/1488] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:47.283879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8959d-809a-4c9f-961a-7ae521459f87 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.284351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8959d-809a-4c9f-961a-7ae521459f87 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.284452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8959d-809a-4c9f-961a-7ae521459f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.355790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-73a8959d-809a-4c9f-961a-7ae521459f87 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:47.357015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-73a8959d-809a-4c9f-961a-7ae521459f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:47.408421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:47.452564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 749/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:47.747024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fd0c-f126-4dbf-84c8-5170ae85c336 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:47.748579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5547fd0c-f126-4dbf-84c8-5170ae85c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:47.785448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:47.853106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fd0c-f126-4dbf-84c8-5170ae85c336 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:47.928626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:47.929235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.929517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.929790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.931706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:48.010758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:48.040072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:48.041497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d8d2-0180-4ffd-aa0f-48b51d7863f9 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:48.060342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 741/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:44:50.177335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719aaf5-ce32-4b76-8909-2ba9de8af085 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.177892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719aaf5-ce32-4b76-8909-2ba9de8af085 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.177892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719aaf5-ce32-4b76-8909-2ba9de8af085 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.179265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 750/1491] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 12 11:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:50.184589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b025-ae7d-4f3a-8a58-2ab29aabe8d2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.185051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b025-ae7d-4f3a-8a58-2ab29aabe8d2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.185154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b025-ae7d-4f3a-8a58-2ab29aabe8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.251344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-28b0b025-ae7d-4f3a-8a58-2ab29aabe8d2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:50.252559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-28b0b025-ae7d-4f3a-8a58-2ab29aabe8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:50.346984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 742/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:44:50.635080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719aaf5-ce32-4b76-8909-2ba9de8af085 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.636621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3719aaf5-ce32-4b76-8909-2ba9de8af085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:50.737453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719aaf5-ce32-4b76-8909-2ba9de8af085 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.809046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.809643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.809923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.810190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.812460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:50.821417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.920218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.922158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc212a-be15-4a85-8f1b-d643b09be43d service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.939771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 751/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:45:00.345223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=82 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.937507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=50 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:10.308099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:10.309250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:10.309250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:10.382579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:10.383832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:10.478130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 743/1494] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:46:10.486882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:10.487368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:10.487472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:10.560203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:10.561316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:10.653809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 752/1495] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:46:10.658483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:10.659730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:10.671654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4cecd-81b1-4a43-97aa-efdd7de71a70 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:10.732603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:10.766007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:10.766640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:10.766917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:10.767189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:10.767823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:10.768125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:10.769120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:10.769120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:46:10.769120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:46:10.770005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:10.781465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 744/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:10.789737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:10.798673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c453-fb4a-4add-bfef-c6924d0a2ddb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:10.859031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:10.892532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:10.893131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:10.893403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:10.893669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:10.894275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:10.896016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:10.896016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:46:10.896016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:46:10.897201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:10.953461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 753/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:46:10 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:10.957648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:10.959275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:10.991903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00b23-c9e9-4f7b-9bfa-35b3707a1088 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:11.085828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:11.086436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.086756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.087035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.087659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:11.088665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:11.088665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:46:11.088665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:46:11.090474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:11.132187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 745/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:46:10 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:11.136212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:11.138314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:11.202317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce082c-d66b-446e-9f44-4ab157255f6b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:11.292952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:11.304645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:11.305503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.305778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.306049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.306710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:11.307720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:11.307720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:46:11.307720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:46:11.309095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:11.321575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 754/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:46:11.326267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:11.327910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:11.339204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a78f3-4a6d-4551-ac14-3702310af83f admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:11.363484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:11.432691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:11.433748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.434030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.434304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.434974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:11.436030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:11.436030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:46:11.436030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:46:11.436923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2062918-a45e-4294-8f9a-96b64a3a7cf1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:11.449398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 746/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:46:11.453669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:11.455225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:11.488136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6eb73-1d25-4b3e-93c4-8faedc8cee47 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:11.580270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:11.580920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.581196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.581470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] PATH_INFO: `/v3/projects/67aace5e68f34a2ba37c4c07a9053ff9/users/ca897b549d984dc889b38eec732e1b99/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.602444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67aace5e68f34a2ba37c4c07a9053ff9, user_id=ca897b549d984dc889b38eec732e1b99, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:11.603492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:11.603492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:46:11.603492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:46:11.605919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe535f-4c03-49df-b1f4-ca8b8e1e7f61 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:11.629820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 755/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:46:11 2022] PUT /identity/v3/projects/67aace5e68f34a2ba37c4c07a9053ff9/users/ca897b549d984dc889b38eec732e1b99/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:46:11.641699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6769-e966-4970-9dcd-cd746fa4a156 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.641989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6769-e966-4970-9dcd-cd746fa4a156 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.642269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6769-e966-4970-9dcd-cd746fa4a156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.698371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-6e0c6769-e966-4970-9dcd-cd746fa4a156 None None] MFA Rules not processed for user `ca897b549d984dc889b38eec732e1b99`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:11.699524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6e0c6769-e966-4970-9dcd-cd746fa4a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:11.777537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 747/1502] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:46:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:46:11.790426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ef17d-5798-454e-a80b-8ccb47b0573b None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.790741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ef17d-5798-454e-a80b-8ccb47b0573b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.791013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ef17d-5798-454e-a80b-8ccb47b0573b None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.792356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 756/1503] 10.222.0.42 () {54 vars in 964 bytes} [Fri Aug 12 11:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:11.797491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947323d-dc53-4551-894c-0c3c0d524e8c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:11.797776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947323d-dc53-4551-894c-0c3c0d524e8c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:11.798049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947323d-dc53-4551-894c-0c3c0d524e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:11.829408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:11.874386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0947323d-dc53-4551-894c-0c3c0d524e8c None None] MFA Rules not processed for user `76127525ce2e45a3b53487d0f92014ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:11.875596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0947323d-dc53-4551-894c-0c3c0d524e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:11.949656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 748/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Aug 12 11:46:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:46:11.957276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ef17d-5798-454e-a80b-8ccb47b0573b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:11.958814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c94ef17d-5798-454e-a80b-8ccb47b0573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:12.007448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.060268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ef17d-5798-454e-a80b-8ccb47b0573b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:12.135331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:12.135932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.136208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.136509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.138120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:12.233626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:12.235002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:12.238345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.252862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 757/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:46:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:46:12.297155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5abc-b65c-40e3-8bfc-4b3696276c9f None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.297442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5abc-b65c-40e3-8bfc-4b3696276c9f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.297717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5abc-b65c-40e3-8bfc-4b3696276c9f None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.298993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 749/1506] 10.222.0.42 () {52 vars in 830 bytes} [Fri Aug 12 11:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:12.302554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:12.303785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:12.403201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a35f-d370-4696-9b57-a14baadb80e7 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:12.495966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:12.496593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.496869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.497136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] PATH_INFO: `/v3/users/ca897b549d984dc889b38eec732e1b99` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.509276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca897b549d984dc889b38eec732e1b99)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:12.510295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:12.510295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:46:12.510295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:46:12.512034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:12.521762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.577568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca897b549d984dc889b38eec732e1b99'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:12.587763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca897b549d984dc889b38eec732e1b99'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:12.601633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca897b549d984dc889b38eec732e1b99'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:12.624330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca897b549d984dc889b38eec732e1b99'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:12.624790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca897b549d984dc889b38eec732e1b99'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:12.630554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 758/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:46:12 2022] DELETE /identity/v3/users/ca897b549d984dc889b38eec732e1b99 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:46:12.635078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.635572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.635668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.691112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:12.692286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:12.766068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.778931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 750/1508] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:46:12.788399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:12.789619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:12.887198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77808a-0fc7-42e1-8731-961e1824210f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:12.941317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.964681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:12.965293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.965577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.965854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.967497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:13.073965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:13.075442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41211f-c43c-4229-b70c-8a6391eb5dce service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:13.092923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 759/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:46:13.459010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:13.460280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:13.472103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ffc9c-59ef-4c26-9327-f2f560d01037 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:13.566516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:13.567175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:13.567453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:13.567724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] PATH_INFO: `/v3/projects/67aace5e68f34a2ba37c4c07a9053ff9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:13.578754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] RBAC: Authorizing `identity:delete_project(project_id=67aace5e68f34a2ba37c4c07a9053ff9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:13.579773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:46:13.579773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:46:13.579773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:46:13.580979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:13.637495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67aace5e68f34a2ba37c4c07a9053ff9', 'request_id': 'req-75453905-7eb7-49b4-b308-3235a974071b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:13.650036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67aace5e68f34a2ba37c4c07a9053ff9', 'request_id': 'req-75453905-7eb7-49b4-b308-3235a974071b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:13.659676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67aace5e68f34a2ba37c4c07a9053ff9', 'request_id': 'req-75453905-7eb7-49b4-b308-3235a974071b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:13.685784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] The token cache is being invalidate because project 67aace5e68f34a2ba37c4c07a9053ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:46:13.686073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:13.686503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-75453905-7eb7-49b4-b308-3235a974071b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:46:13.687943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 751/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:46:13 2022] DELETE /identity/v3/projects/67aace5e68f34a2ba37c4c07a9053ff9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:46:23.090662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=62 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:23.683765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:42.344085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0f3b3-8142-4ef8-9c69-6343df268135 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:42.344678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0f3b3-8142-4ef8-9c69-6343df268135 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:42.344678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0f3b3-8142-4ef8-9c69-6343df268135 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:42.346030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:47:42.350738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b0c2-4fa4-47c9-8b73-53d66a8d2f1e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:42.351184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b0c2-4fa4-47c9-8b73-53d66a8d2f1e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:42.351299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b0c2-4fa4-47c9-8b73-53d66a8d2f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:42.431784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-de13b0c2-4fa4-47c9-8b73-53d66a8d2f1e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:42.432982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-de13b0c2-4fa4-47c9-8b73-53d66a8d2f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:42.537685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:47:42.689149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0f3b3-8142-4ef8-9c69-6343df268135 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:42.691338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d8e0f3b3-8142-4ef8-9c69-6343df268135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:42.806888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0f3b3-8142-4ef8-9c69-6343df268135 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:42.812226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97968-226c-4316-818b-eb020610b6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:42.812854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97968-226c-4316-818b-eb020610b6dc service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:42.813136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97968-226c-4316-818b-eb020610b6dc service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:42.813411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97968-226c-4316-818b-eb020610b6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:42.821238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97968-226c-4316-818b-eb020610b6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:42.823466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97968-226c-4316-818b-eb020610b6dc service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:42.832545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 761/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:47:43.344368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618dfef-95c3-466f-af2a-63c22a97b54d None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:43.344747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618dfef-95c3-466f-af2a-63c22a97b54d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:43.345034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618dfef-95c3-466f-af2a-63c22a97b54d None None] PATH_INFO: `/v3` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:43.346420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 753/1514] 10.222.0.43 () {54 vars in 925 bytes} [Fri Aug 12 11:47:43 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:47:43.354006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765836e0-6ef6-4ab6-8d72-68a68380e771 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:43.354505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765836e0-6ef6-4ab6-8d72-68a68380e771 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:43.354633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765836e0-6ef6-4ab6-8d72-68a68380e771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:43.416443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-765836e0-6ef6-4ab6-8d72-68a68380e771 None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:43.417651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-765836e0-6ef6-4ab6-8d72-68a68380e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:43.482904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:43.488378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 762/1515] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 12 11:47:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:47:43.668457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd0a8-b15d-4ec2-b2da-3329210c8ab7 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:43.668960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd0a8-b15d-4ec2-b2da-3329210c8ab7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:43.668960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd0a8-b15d-4ec2-b2da-3329210c8ab7 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:43.670315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 754/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:47:43.675014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234077c-09e5-4f47-8731-cdc43f2c5aaa None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:43.675300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234077c-09e5-4f47-8731-cdc43f2c5aaa None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:43.675572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234077c-09e5-4f47-8731-cdc43f2c5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:43.694859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-9234077c-09e5-4f47-8731-cdc43f2c5aaa None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:43.696029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9234077c-09e5-4f47-8731-cdc43f2c5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:43.704182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 763/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:47:43.852459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fd0a8-b15d-4ec2-b2da-3329210c8ab7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:43.866939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fd0a8-b15d-4ec2-b2da-3329210c8ab7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:43.872510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9565c-f468-4e6f-8caf-dda81747f295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:43.873113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9565c-f468-4e6f-8caf-dda81747f295 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:43.873399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9565c-f468-4e6f-8caf-dda81747f295 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:43.873674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9565c-f468-4e6f-8caf-dda81747f295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:43.881780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9565c-f468-4e6f-8caf-dda81747f295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:43.883413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9565c-f468-4e6f-8caf-dda81747f295 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:43.893198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 755/1518] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:47:52.515885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d94d1-96cc-46de-a651-f24063aa97bb None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:52.516464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d94d1-96cc-46de-a651-f24063aa97bb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:52.516464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d94d1-96cc-46de-a651-f24063aa97bb None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:52.517693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 764/1519] 10.222.0.42 () {54 vars in 961 bytes} [Fri Aug 12 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:47:52.522708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638c010-4f1a-4a0e-bd17-421b7b1f804e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:52.523173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638c010-4f1a-4a0e-bd17-421b7b1f804e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:52.523279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638c010-4f1a-4a0e-bd17-421b7b1f804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:52.542302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c638c010-4f1a-4a0e-bd17-421b7b1f804e None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:52.543500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c638c010-4f1a-4a0e-bd17-421b7b1f804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:52.551881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 756/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Aug 12 11:47:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:47:52.559892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d94d1-96cc-46de-a651-f24063aa97bb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:52.573616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d94d1-96cc-46de-a651-f24063aa97bb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:52.578623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e9656-35e7-493c-9e0e-527ae66b13ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:52.579245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e9656-35e7-493c-9e0e-527ae66b13ff service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:52.579530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e9656-35e7-493c-9e0e-527ae66b13ff service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:52.579805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e9656-35e7-493c-9e0e-527ae66b13ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:52.587883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e9656-35e7-493c-9e0e-527ae66b13ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:52.589461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e9656-35e7-493c-9e0e-527ae66b13ff service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:52.598859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 765/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:47:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:47:55.103909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558de8-2e8e-467a-a1ad-b6120ce1204a None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:55.104469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558de8-2e8e-467a-a1ad-b6120ce1204a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:55.104469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558de8-2e8e-467a-a1ad-b6120ce1204a None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:55.105785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:47:55.110595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fba47-3ae7-4100-956d-f1121b57d5f4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:55.111027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fba47-3ae7-4100-956d-f1121b57d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:55.111179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fba47-3ae7-4100-956d-f1121b57d5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:55.130890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-364fba47-3ae7-4100-956d-f1121b57d5f4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:55.131997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-364fba47-3ae7-4100-956d-f1121b57d5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:55.139600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:47:55.293173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558de8-2e8e-467a-a1ad-b6120ce1204a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:55.308157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558de8-2e8e-467a-a1ad-b6120ce1204a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:55.313461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e494b22-2919-405f-bb94-860c6d85e375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:55.314046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e494b22-2919-405f-bb94-860c6d85e375 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:55.314324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e494b22-2919-405f-bb94-860c6d85e375 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:55.314595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e494b22-2919-405f-bb94-860c6d85e375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:55.322475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e494b22-2919-405f-bb94-860c6d85e375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:55.324105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e494b22-2919-405f-bb94-860c6d85e375 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:55.333263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 758/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:47:56.154177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190800a-e1d6-4269-a454-5464cbe61799 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:56.154768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190800a-e1d6-4269-a454-5464cbe61799 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:56.154768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190800a-e1d6-4269-a454-5464cbe61799 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:56.156092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:47:56.160707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad48d8-e6cf-416e-933d-ea69757b00d6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:56.161101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad48d8-e6cf-416e-933d-ea69757b00d6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:56.161261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad48d8-e6cf-416e-933d-ea69757b00d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:56.180431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a3ad48d8-e6cf-416e-933d-ea69757b00d6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:56.182146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a3ad48d8-e6cf-416e-933d-ea69757b00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:56.189911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:47:56.342157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190800a-e1d6-4269-a454-5464cbe61799 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:56.356943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190800a-e1d6-4269-a454-5464cbe61799 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:56.362303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8d642-0e4f-4800-bb92-fa07d6d40557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:56.362916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8d642-0e4f-4800-bb92-fa07d6d40557 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:56.363198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8d642-0e4f-4800-bb92-fa07d6d40557 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:56.363473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8d642-0e4f-4800-bb92-fa07d6d40557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:56.371344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8d642-0e4f-4800-bb92-fa07d6d40557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:56.372907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8d642-0e4f-4800-bb92-fa07d6d40557 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:56.381979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 768/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:48:00.348002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ae33-df25-497f-b0f7-dfc69e06a5c2 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:00.348563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ae33-df25-497f-b0f7-dfc69e06a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:00.348563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ae33-df25-497f-b0f7-dfc69e06a5c2 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:00.349877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:00.355473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f487ac-2f3f-44c7-9c84-c35e0baddf93 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:00.355887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f487ac-2f3f-44c7-9c84-c35e0baddf93 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:00.356028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f487ac-2f3f-44c7-9c84-c35e0baddf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:00.375447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-89f487ac-2f3f-44c7-9c84-c35e0baddf93 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:00.376646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-89f487ac-2f3f-44c7-9c84-c35e0baddf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:00.384899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:48:00.669397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ae33-df25-497f-b0f7-dfc69e06a5c2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:00.671524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a972ae33-df25-497f-b0f7-dfc69e06a5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:00.703883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:00.750391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ae33-df25-497f-b0f7-dfc69e06a5c2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:00.753983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c3409-ce2b-498f-b822-278691506f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:00.754591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3409-ce2b-498f-b822-278691506f95 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:00.754906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3409-ce2b-498f-b822-278691506f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:00.755183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3409-ce2b-498f-b822-278691506f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:00.764028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c3409-ce2b-498f-b822-278691506f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:00.765444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c3409-ce2b-498f-b822-278691506f95 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:00.775402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 761/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:48:02.673294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981cf0-48df-4d36-b3dc-ab0cb9f85877 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.673865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981cf0-48df-4d36-b3dc-ab0cb9f85877 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.673865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981cf0-48df-4d36-b3dc-ab0cb9f85877 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.675230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:02.681190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1605-50a7-4c7b-9191-00fd8a83c503 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.681631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1605-50a7-4c7b-9191-00fd8a83c503 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.681736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1605-50a7-4c7b-9191-00fd8a83c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.700756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-65cc1605-50a7-4c7b-9191-00fd8a83c503 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:02.701932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-65cc1605-50a7-4c7b-9191-00fd8a83c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:02.709553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:48:02.994897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981cf0-48df-4d36-b3dc-ab0cb9f85877 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.005437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981cf0-48df-4d36-b3dc-ab0cb9f85877 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:03.008939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818729c6-0c3b-419f-9d40-f1a974dbb58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:03.009522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818729c6-0c3b-419f-9d40-f1a974dbb58c service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:03.009826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818729c6-0c3b-419f-9d40-f1a974dbb58c service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:03.010065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818729c6-0c3b-419f-9d40-f1a974dbb58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:03.018529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818729c6-0c3b-419f-9d40-f1a974dbb58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:03.019974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818729c6-0c3b-419f-9d40-f1a974dbb58c service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:03.029516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 771/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:48:06.492360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222282-9ef2-447b-9171-2042935c5713 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:06.493651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222282-9ef2-447b-9171-2042935c5713 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:06.493651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222282-9ef2-447b-9171-2042935c5713 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:06.494857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:06.500086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769412-ba10-4a8b-a63c-c6424d074c54 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:06.500516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769412-ba10-4a8b-a63c-c6424d074c54 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:06.500631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769412-ba10-4a8b-a63c-c6424d074c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:06.520254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-04769412-ba10-4a8b-a63c-c6424d074c54 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:06.521456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-04769412-ba10-4a8b-a63c-c6424d074c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:06.529204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:48:07.076706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222282-9ef2-447b-9171-2042935c5713 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.078409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ef222282-9ef2-447b-9171-2042935c5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:07.157837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222282-9ef2-447b-9171-2042935c5713 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.161322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59dde1-5dd1-452f-a38a-9ebd39e7bf7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.161934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59dde1-5dd1-452f-a38a-9ebd39e7bf7e service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.162217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59dde1-5dd1-452f-a38a-9ebd39e7bf7e service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.162489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59dde1-5dd1-452f-a38a-9ebd39e7bf7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.171788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59dde1-5dd1-452f-a38a-9ebd39e7bf7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.173221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59dde1-5dd1-452f-a38a-9ebd39e7bf7e service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.183474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 764/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:48:09.114053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14688d-976a-4925-9b12-cf0451517e6d None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:09.114664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14688d-976a-4925-9b12-cf0451517e6d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:09.114664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14688d-976a-4925-9b12-cf0451517e6d None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:09.116026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:09.121341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96beb-c8a2-4508-819c-dbb7bab412c5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:09.121811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96beb-c8a2-4508-819c-dbb7bab412c5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:09.121910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96beb-c8a2-4508-819c-dbb7bab412c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:09.144693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-eeb96beb-c8a2-4508-819c-dbb7bab412c5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:09.145822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-eeb96beb-c8a2-4508-819c-dbb7bab412c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:09.155444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:48:09.711230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14688d-976a-4925-9b12-cf0451517e6d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:09.713496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2f14688d-976a-4925-9b12-cf0451517e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:09.726117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14688d-976a-4925-9b12-cf0451517e6d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:09.730150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e33b2-1082-4d6c-80aa-e47431b22554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:09.730766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e33b2-1082-4d6c-80aa-e47431b22554 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:09.731042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e33b2-1082-4d6c-80aa-e47431b22554 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:09.731309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e33b2-1082-4d6c-80aa-e47431b22554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:09.739825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e33b2-1082-4d6c-80aa-e47431b22554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:09.741226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e33b2-1082-4d6c-80aa-e47431b22554 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:09.750254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 774/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:48:19.139456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=63 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:19.746247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=37 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:32.303330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.303963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.303963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.336150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.337458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.347538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 766/1540] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.356332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035667-781e-4eb8-9939-8bebcd9e9a2b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.356917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035667-781e-4eb8-9939-8bebcd9e9a2b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.356917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035667-781e-4eb8-9939-8bebcd9e9a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.389115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a6035667-781e-4eb8-9939-8bebcd9e9a2b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.390329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a6035667-781e-4eb8-9939-8bebcd9e9a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.403054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 775/1541] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:32.407621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.418782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cf2fe-0173-473a-bdf3-015570ef7fb9 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.430837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.431452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.431762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.432006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.432663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:32.432968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.434571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.451802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4550-b6ae-4ad8-a7ac-5afd2bc12e0d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.452168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4550-b6ae-4ad8-a7ac-5afd2bc12e0d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.452358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4550-b6ae-4ad8-a7ac-5afd2bc12e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.453320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 767/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:32.464321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.477302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f169-3265-4b29-9670-86f5c5dfb309 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.484838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-108f4550-b6ae-4ad8-a7ac-5afd2bc12e0d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.486080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-108f4550-b6ae-4ad8-a7ac-5afd2bc12e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.489853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.490529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.490838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.491146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.492800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.493883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:49:32.493883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:49:32.493883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:49:32.495695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.512580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 776/1543] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.514213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56220102-fa66-4f87-8b58-4098b318ff7d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.514498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56220102-fa66-4f87-8b58-4098b318ff7d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.514802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56220102-fa66-4f87-8b58-4098b318ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.556902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-56220102-fa66-4f87-8b58-4098b318ff7d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.558297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-56220102-fa66-4f87-8b58-4098b318ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.573949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 777/1544] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.575394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965242f-7ac4-4ec6-ab4d-77e466b9139d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.575680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965242f-7ac4-4ec6-ab4d-77e466b9139d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.575946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965242f-7ac4-4ec6-ab4d-77e466b9139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.578143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 768/1545] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:49:32.582328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.615877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1965242f-7ac4-4ec6-ab4d-77e466b9139d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.617108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1965242f-7ac4-4ec6-ab4d-77e466b9139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.694663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e4c7-4876-4c79-b5d5-f4696d497b4d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.697388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 778/1546] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.698680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013f25-ea77-4c5d-8157-f87b1c7f3b12 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.698992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013f25-ea77-4c5d-8157-f87b1c7f3b12 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.699271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013f25-ea77-4c5d-8157-f87b1c7f3b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.708173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.709910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.710203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.710484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.711199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.713158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.732462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-bf013f25-ea77-4c5d-8157-f87b1c7f3b12 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.733851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-bf013f25-ea77-4c5d-8157-f87b1c7f3b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.746682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 779/1547] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.747935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec19c09-b9ea-4581-91ca-0a09a2589466 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.748291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec19c09-b9ea-4581-91ca-0a09a2589466 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.748570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec19c09-b9ea-4581-91ca-0a09a2589466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.766232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 769/1548] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:32.767543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.775121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-9ec19c09-b9ea-4581-91ca-0a09a2589466 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.776382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9ec19c09-b9ea-4581-91ca-0a09a2589466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.783728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a70d99-bd26-44bb-93f2-524725ddab76 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.784619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 780/1549] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.785651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.785933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.786204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.789770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.790446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.790759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.791038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.791723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:32.791986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.793679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c028074-d5b4-4286-a13c-05bfb619dfc5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.806234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.807101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 770/1550] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:32.807436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.808289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b044-73ef-4791-aa4a-2b03146db9f0 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.808660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b044-73ef-4791-aa4a-2b03146db9f0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.808937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25b044-73ef-4791-aa4a-2b03146db9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.815412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 781/1551] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.816181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.825604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d580c-a552-4b6c-ba68-04e85f15bd92 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.828906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4a25b044-73ef-4791-aa4a-2b03146db9f0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.830092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4a25b044-73ef-4791-aa4a-2b03146db9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.830264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.830884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.831163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.831440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.832074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:32.832371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.833377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:49:32.833377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:49:32.833377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:49:32.834259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.839185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 771/1552] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.840365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc017-3966-4064-bc8b-1290e7f34ec3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.840647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc017-3966-4064-bc8b-1290e7f34ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.840921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc017-3966-4064-bc8b-1290e7f34ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.848269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 782/1553] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:32.849395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.859963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00bc6-9b2f-43d6-8f4a-f4e1323d912a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.863640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-68fcc017-3966-4064-bc8b-1290e7f34ec3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.864521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab786c-0bf8-4d19-b193-a71873a00388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.864839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-68fcc017-3966-4064-bc8b-1290e7f34ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.865111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab786c-0bf8-4d19-b193-a71873a00388 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.865387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab786c-0bf8-4d19-b193-a71873a00388 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.865787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab786c-0bf8-4d19-b193-a71873a00388 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.866425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab786c-0bf8-4d19-b193-a71873a00388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.868072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab786c-0bf8-4d19-b193-a71873a00388 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.873121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 772/1554] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.874455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.874787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.875065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.882596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 783/1555] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:32.883894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bb09-c6e2-44cf-93c9-ee8e0e781b3f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.884180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bb09-c6e2-44cf-93c9-ee8e0e781b3f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.884447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bb09-c6e2-44cf-93c9-ee8e0e781b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.894919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.896115 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.903320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1d00bb09-c6e2-44cf-93c9-ee8e0e781b3f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.904471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1d00bb09-c6e2-44cf-93c9-ee8e0e781b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.904693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 773/1556] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.905434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.912902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 784/1557] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.914786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa84b3-4bda-4b07-8dbe-2c7d907e1df4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.915069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa84b3-4bda-4b07-8dbe-2c7d907e1df4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.915350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa84b3-4bda-4b07-8dbe-2c7d907e1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.915533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00187dae-29e7-45a7-a190-c1672cf5bb99 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:32.920129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:32.920720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.921002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.921278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.921896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:32.923843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:32.934642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7bfa84b3-4bda-4b07-8dbe-2c7d907e1df4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.936211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7bfa84b3-4bda-4b07-8dbe-2c7d907e1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.945065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 785/1558] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:32.946215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bbbac-b21a-423e-ad8d-7bc2f41ff691 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:32.946505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bbbac-b21a-423e-ad8d-7bc2f41ff691 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:32.946810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bbbac-b21a-423e-ad8d-7bc2f41ff691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:32.952484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 774/1559] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:32.953434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:32.970689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3b4bbbac-b21a-423e-ad8d-7bc2f41ff691 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:32.972011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3b4bbbac-b21a-423e-ad8d-7bc2f41ff691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:32.998168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:33.015858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494cc0-01a6-4d93-8595-534a03ab4507 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.020656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.021264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.021549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.021822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.022445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.024901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.036044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 786/1560] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:33.036044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e2ec-c4ec-44d2-aed2-94c774c4ef7a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.036044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e2ec-c4ec-44d2-aed2-94c774c4ef7a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.036044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e2ec-c4ec-44d2-aed2-94c774c4ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.054150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ca16e2ec-c4ec-44d2-aed2-94c774c4ef7a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:33.054745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 775/1561] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:32 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.058258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ca16e2ec-c4ec-44d2-aed2-94c774c4ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:33.058390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.079932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:33.125765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 787/1562] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:33.126811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c201a-d151-4c4e-bfd2-20c0fba1f161 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.127233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.127610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.127944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.134229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.134863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.135141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.135412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.136050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.137638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.147078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:33.147758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 776/1563] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:33.148283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:33.149140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.159759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 788/1564] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:33.160624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f805f9-749f-4005-afe3-e29b06bf4031 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.160886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.165345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.165924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.166203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.166476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.167143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:33.167472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.169044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.170224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd5ae-b276-4d0e-aa7a-7303292dc2ed None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.174760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.175334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.175616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.175888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.176521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:33.176823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.178411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.186789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 777/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:33.186789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.191341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0220e-d057-4a5d-8aed-6e51358bc065 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.196596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.197104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 789/1566] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:33.197230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.197442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.197720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.198334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.199628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.200304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.213749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858665-3051-48b3-ac0a-d6c5b258c0c7 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.218586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.219201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.219475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.219747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.220382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:33.220693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.222260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.224572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 778/1567] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.225365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.234799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3047a-e5ed-4b4e-b405-07b89d84904f admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.244102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 790/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:33.244102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.244404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.244404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.244404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.244404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.244806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.244806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.254149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ed866-f41f-4981-9388-defdb97d0f5a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.259327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.259910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.260187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.260458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.261135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:33.261440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.263055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.265691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 779/1569] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.266483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.275636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 791/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:33.276380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d071-3b0e-49db-b69c-f07cb5a277d3 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.276779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.286043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.286762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.287050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.287325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] PATH_INFO: `/v3/projects/21becf9fae12443c85cd1605e1fd82d1/users/48918266672f4b67804708b320c1e0b6/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.293180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc0734-0556-4c4e-a3c2-40cedbc0b7bb admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.299615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.303224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.303569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.304066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21becf9fae12443c85cd1605e1fd82d1, user_id=48918266672f4b67804708b320c1e0b6, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.304529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.305303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:33.305565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:49:33.305565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:49:33.305565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:49:33.305848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.307291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.307936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.321361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 792/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:33.322147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.322364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 780/1572] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:33 2022] PUT /identity/v3/projects/21becf9fae12443c85cd1605e1fd82d1/users/48918266672f4b67804708b320c1e0b6/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:33.323212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.342067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0496f1-adcb-4be8-af06-f4cd5b08652c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.376210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:33.387186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02225e4a-6385-4dcd-902b-eee5355f4278 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.392513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.393113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.393390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.393660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.394272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.396205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.399224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.399835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.400114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.400387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.401181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.403478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.422710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 781/1573] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.423512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.434174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 793/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.435176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.484810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:33.487909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14690709-e7e0-4308-b4aa-b7810e2e59c0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.492611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.493194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.493470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.493749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.494385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.496023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.496761 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9644a5-667f-486a-81f8-f18315915187 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.501362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.501956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.502233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.502504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.503151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.505076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.505749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 782/1575] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:33.506530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.516875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1803d04-c047-4d2a-82d9-743ee084d7cd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.521931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.522559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.522926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.523148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.524424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.526035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.533624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 794/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.534959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.539558 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 783/1577] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:33.540230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.549559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72a1e-c28d-4839-abf2-676cf8fe5a02 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.597982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b03a1d-a20a-433e-bea4-4bf4047c7840 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.602617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9101-f733-402e-88a8-812950762b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.603264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9101-f733-402e-88a8-812950762b49 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.603518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9101-f733-402e-88a8-812950762b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.603800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9101-f733-402e-88a8-812950762b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.604422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b9101-f733-402e-88a8-812950762b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.605387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.605990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.606273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.606369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b9101-f733-402e-88a8-812950762b49 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.606700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.607322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.609208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.634814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 795/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.636063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 784/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.636816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.639186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.639473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.639756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.670293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] MFA Rules not processed for user `48918266672f4b67804708b320c1e0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:33.671544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:33.685848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:33.700552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5448b60-1d87-436d-8130-a66d7abcea0b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.706702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.707316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.707710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.708032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.708824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.710787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.732812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 785/1580] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.733608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.739523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 796/1581] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:33.739523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.749138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e1ca-3cd9-47cb-8896-ac73295dd4f3 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.750380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2deae-7ae3-4d3d-a9a2-5d17fbec69ce None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.753931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.754534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.754868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.755135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.755244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.755760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.755868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.756086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.756360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.757006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.757669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.759221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.769262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 797/1582] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:33.770098 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.780367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 786/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.780583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8586-999f-4fed-a4d9-0d3f3cc55f94 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.781553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.787178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.787774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.788050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.788344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.788972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.790037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:49:33.790037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:49:33.790037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:49:33.791325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.791631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7e01-84d1-481c-93c9-c467c2988bee admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.796175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.796749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.797029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.797300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.797928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.799531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.811478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 787/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:33.812377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.816703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 798/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.816703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.822973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cf50-fdea-495e-810b-f07c4522459e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.828034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1122-5ec7-4819-8b29-facdd5a3e703 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.831512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.832142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.832425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.832668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.832806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.833261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.833415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.833570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.833882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.834496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.835378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.836462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.858199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 788/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 303 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.859439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.862649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 799/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.862649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.868295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:33.871966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e009-0928-4ed5-acb8-30073c3f06d5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.874043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bb64-e60a-4e9a-aeb9-f4df0daabc72 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.877934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.879251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.879554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.879686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.880063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.880196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.880491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.880770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.880937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.881417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.883662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.883801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.894892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 789/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:33.895758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.907479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67cac6-418b-467a-892a-12a355ac0374 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:33.912082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:33.912729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:33.912847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 800/1589] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:33.913577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.915026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:33.915435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] PATH_INFO: `/v3/projects/8299891a8d134af4be3f84cdc7abec51/users/72a30400dec14a85889af8d8dd59886e/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:33.931362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8299891a8d134af4be3f84cdc7abec51, user_id=72a30400dec14a85889af8d8dd59886e, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:33.933995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:33.946880 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 790/1590] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:33 2022] PUT /identity/v3/projects/8299891a8d134af4be3f84cdc7abec51/users/72a30400dec14a85889af8d8dd59886e/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:33.950808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:33.978993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c28c5-4707-437e-aaf9-516447509e19 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.006931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a464-e5a4-4a63-84c8-38f88267d139 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.012149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.012813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.013092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.013370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] PATH_INFO: `/v3/projects/ecebdd96e25642468903a1657a8ee82d/users/381f8ca947954e01b6255626d4a2888f/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.028296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecebdd96e25642468903a1657a8ee82d, user_id=381f8ca947954e01b6255626d4a2888f, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.030997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.035442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.036049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.036345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.036724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.037464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.039403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.044939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 791/1591] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:33 2022] PUT /identity/v3/projects/ecebdd96e25642468903a1657a8ee82d/users/381f8ca947954e01b6255626d4a2888f/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.045815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.051981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 801/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.051981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.059550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4856b53-ed73-4e11-bda9-7a032e1b2b5c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.093261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.114388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305c1f-1f62-48cd-bbb3-97289fabeb48 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.116088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.116944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.117232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.117534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.118203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.119543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.119841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.120151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.120435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.120711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.121354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.122970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.133452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 802/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.133452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.133984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 792/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.134885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.143475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10588c33-35b2-4989-bb95-a7d70f5e90f7 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.144376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb04e5-c02f-469e-936d-514e451ec6e9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.148104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.149300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.149581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.149679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012791-171d-40e1-8d35-4b6f42cb1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.149854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.150178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012791-171d-40e1-8d35-4b6f42cb1b5c admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.150462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012791-171d-40e1-8d35-4b6f42cb1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.150562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.150775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012791-171d-40e1-8d35-4b6f42cb1b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.151405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012791-171d-40e1-8d35-4b6f42cb1b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.152099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.152973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46012791-171d-40e1-8d35-4b6f42cb1b5c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.162517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 803/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.166256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 793/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.166410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.166521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203312-5e91-4825-a98a-f9970ce7c7fa None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.166521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203312-5e91-4825-a98a-f9970ce7c7fa None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.166521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203312-5e91-4825-a98a-f9970ce7c7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.174537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b024ef-0cf0-44a6-8040-fd23163d319b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.179213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.180130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.180407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.180704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.181336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.183317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.183670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-84203312-5e91-4825-a98a-f9970ce7c7fa None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.184876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-84203312-5e91-4825-a98a-f9970ce7c7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.192449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 794/1597] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:34.193681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.193829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.194022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.194301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.210790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 804/1598] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:34.212142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.219826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.221026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.222653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934b4c8-1a2d-43ba-b478-4c21a331e642 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.227267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.227871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.228224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.228491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.228731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 795/1599] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:34.229147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.229490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.230851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.239195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615ca6-241c-4544-ba50-98a0f611aa70 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.244504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 805/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.244504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.244732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.244732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.244947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.245111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.245756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.247418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.255476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c77e3-e8d8-4b3c-8f51-6772377c4e67 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.261070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 796/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.261070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.261319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.261957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.262241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.262514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.263178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.264799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.268396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed23c7-292b-447b-89c2-f82ab34a884a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.274182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.274813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.275101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.275440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.275893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 806/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.276098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.276648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.277740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.285717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b879cc-2209-4adf-bd2f-1ae8dfab4511 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.290658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 797/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.290658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.292924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.293553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.293828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.294099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] PATH_INFO: `/v3/projects/a7e2fce9e9db463aa70188453f20d110/users/64ec7445644e478ca961be80f84f9863/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.308856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e2fce9e9db463aa70188453f20d110, user_id=64ec7445644e478ca961be80f84f9863, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.311517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.324999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 807/1604] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:34 2022] PUT /identity/v3/projects/a7e2fce9e9db463aa70188453f20d110/users/64ec7445644e478ca961be80f84f9863/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.325784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.346081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ad4e-b31b-4efd-966f-4443a5df155d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.391865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079d35e-130c-40ff-8437-46216c6547de admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.397059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.397665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.397947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.398076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.398190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.398668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.398890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.398994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.399215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.400483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.408420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.409829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.410202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 808/1605] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:34.411013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.420283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f70fe9-e3ff-49bb-bc0c-fac59104137e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.420781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 798/1606] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:34.421575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.424046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.424631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.424907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.425173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.431195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff19d2-3377-42c5-b375-a5f9da2af67e service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.435359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.435851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.436504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.436786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.436889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.437064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] PATH_INFO: `/v3/projects/d95cca31d0b74726995cc29a83582883/users/57a862085cc6454792ee6eeb7e66db1d/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.447399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 809/1607] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:34.448070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.454200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95cca31d0b74726995cc29a83582883, user_id=57a862085cc6454792ee6eeb7e66db1d, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.456787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.458060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f627c-48e1-40f4-a237-5851b9983f7a service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.463049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.463668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.463937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.464208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] PATH_INFO: `/v3/projects/a5add51853d04cd7835169b94db2862a/users/d140838d037a4f698a46516fccdebc96/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.472099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 799/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:34 2022] PUT /identity/v3/projects/d95cca31d0b74726995cc29a83582883/users/57a862085cc6454792ee6eeb7e66db1d/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.481186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5add51853d04cd7835169b94db2862a, user_id=d140838d037a4f698a46516fccdebc96, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.483888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.484028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.499080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 810/1609] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:34 2022] PUT /identity/v3/projects/a5add51853d04cd7835169b94db2862a/users/d140838d037a4f698a46516fccdebc96/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.500387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.518507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.560639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc9bb-f7f5-4b28-aa5e-4dd6524f20f9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.577429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d348-6947-414a-8472-3ee05f6d524e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.583419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f89d1-11bf-4ef2-a823-ea1583f626ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.584133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f89d1-11bf-4ef2-a823-ea1583f626ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.584408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f89d1-11bf-4ef2-a823-ea1583f626ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.584740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f89d1-11bf-4ef2-a823-ea1583f626ce admin admin] PATH_INFO: `/v3/projects/34010de730e4448288baf7e944d52cf9/users/7d02a90e6cb7428985fe399974b385b9/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.598967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.603479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f89d1-11bf-4ef2-a823-ea1583f626ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=34010de730e4448288baf7e944d52cf9, user_id=7d02a90e6cb7428985fe399974b385b9, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.605535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f89d1-11bf-4ef2-a823-ea1583f626ce admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.622485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 811/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:34 2022] PUT /identity/v3/projects/34010de730e4448288baf7e944d52cf9/users/7d02a90e6cb7428985fe399974b385b9/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.624061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da649-6c84-42a8-b8a3-823a65a55930 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.624462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da649-6c84-42a8-b8a3-823a65a55930 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.624910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da649-6c84-42a8-b8a3-823a65a55930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.635404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.636082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.636520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.636813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] PATH_INFO: `/v3/projects/06451ebec8a947829019e1fea6636bc6/users/134faab760d04e3ba537619281c316c9/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.649478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-783da649-6c84-42a8-b8a3-823a65a55930 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.650792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-783da649-6c84-42a8-b8a3-823a65a55930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.653237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06451ebec8a947829019e1fea6636bc6, user_id=134faab760d04e3ba537619281c316c9, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.656119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.673061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 800/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:34 2022] PUT /identity/v3/projects/06451ebec8a947829019e1fea6636bc6/users/134faab760d04e3ba537619281c316c9/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.674134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.747579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 812/1612] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:34.749027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f21c-fc15-44af-8b90-e7c6381f1aa8 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.749308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f21c-fc15-44af-8b90-e7c6381f1aa8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.749575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f21c-fc15-44af-8b90-e7c6381f1aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.761604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06478e-d173-4df6-a67f-a912ab2eb4a0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:34.768339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ee500-f36d-4f8b-8fb9-10494f5fa77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:34.769182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ee500-f36d-4f8b-8fb9-10494f5fa77a admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.769491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ee500-f36d-4f8b-8fb9-10494f5fa77a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.769711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ee500-f36d-4f8b-8fb9-10494f5fa77a admin admin] PATH_INFO: `/v3/projects/fbfcc528ba204d638e0e43112b5db6ee/users/c831172d6f334c29bd05f93c0d944967/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.781874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-abc0f21c-fc15-44af-8b90-e7c6381f1aa8 None None] MFA Rules not processed for user `57a862085cc6454792ee6eeb7e66db1d`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.783757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-abc0f21c-fc15-44af-8b90-e7c6381f1aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.792574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ee500-f36d-4f8b-8fb9-10494f5fa77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfcc528ba204d638e0e43112b5db6ee, user_id=c831172d6f334c29bd05f93c0d944967, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:34.796693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ee500-f36d-4f8b-8fb9-10494f5fa77a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:34.815822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 801/1613] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:34 2022] PUT /identity/v3/projects/fbfcc528ba204d638e0e43112b5db6ee/users/c831172d6f334c29bd05f93c0d944967/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:34.818838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eaa68-184d-4f83-89af-661e360d7951 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.818838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eaa68-184d-4f83-89af-661e360d7951 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.818838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eaa68-184d-4f83-89af-661e360d7951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.837927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-436eaa68-184d-4f83-89af-661e360d7951 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.839270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-436eaa68-184d-4f83-89af-661e360d7951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.862903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 813/1614] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:34.862903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.862903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.862903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.883644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.884959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.892781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:34.933660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 802/1615] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:34.933660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:34.933660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:34.933660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:34.960367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:34.961802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:34.971745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 803/1616] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:34.972390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:34.973661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:35.003407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 814/1617] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:35.004376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.018269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fea520-8f62-4f09-b904-c4aace7745e7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.024248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b71e9-2fc9-4c48-b509-bf924fe8f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.024905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b71e9-2fc9-4c48-b509-bf924fe8f3be admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.025304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b71e9-2fc9-4c48-b509-bf924fe8f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.025638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b71e9-2fc9-4c48-b509-bf924fe8f3be admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.026490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b71e9-2fc9-4c48-b509-bf924fe8f3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.029359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b71e9-2fc9-4c48-b509-bf924fe8f3be admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.044720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 815/1618] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:35.056427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782ff8c-a273-412a-93de-b401143a02fa None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.057352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782ff8c-a273-412a-93de-b401143a02fa None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.057706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782ff8c-a273-412a-93de-b401143a02fa None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.067473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 816/1619] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 12 11:49:35 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:35.068378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782ff8c-a273-412a-93de-b401143a02fa None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.070457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3782ff8c-a273-412a-93de-b401143a02fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:35.085334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:35.107037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17d689-d13d-4fbd-bace-ae9523cf1335 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.111568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.112203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.112490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.112813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.128124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.129650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.143509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 804/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:35.144598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.153071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782ff8c-a273-412a-93de-b401143a02fa None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.157458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.158093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.158424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.158801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.159797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058058-7366-43f4-a685-478a14858a27 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.171931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.173403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.183802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113cece-ee0b-4f39-ad15-b58aaa97cbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.185641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113cece-ee0b-4f39-ad15-b58aaa97cbca service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.185778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 817/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:35.186634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113cece-ee0b-4f39-ad15-b58aaa97cbca service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.186780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.186933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113cece-ee0b-4f39-ad15-b58aaa97cbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.200081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2386c-3dc0-4781-9094-8e575fe70244 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.205430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.206103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.206469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.206923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.213197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113cece-ee0b-4f39-ad15-b58aaa97cbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.218814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113cece-ee0b-4f39-ad15-b58aaa97cbca service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.219788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.221797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.233961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 818/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:35.234882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.243007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 805/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:35.244353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.244652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.245231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.248750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf58b6-a9e3-46b3-a9ed-a0b53e230d07 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.256000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16554b8e-7b4e-4381-90b3-0232033e710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.256900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16554b8e-7b4e-4381-90b3-0232033e710a admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.257187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16554b8e-7b4e-4381-90b3-0232033e710a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.257469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16554b8e-7b4e-4381-90b3-0232033e710a admin admin] PATH_INFO: `/v3/projects/fbfcc528ba204d638e0e43112b5db6ee/users/c831172d6f334c29bd05f93c0d944967/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.260439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16554b8e-7b4e-4381-90b3-0232033e710a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfcc528ba204d638e0e43112b5db6ee, user_id=c831172d6f334c29bd05f93c0d944967, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.264248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16554b8e-7b4e-4381-90b3-0232033e710a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.289654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 819/1624] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:35 2022] PUT /identity/v3/projects/fbfcc528ba204d638e0e43112b5db6ee/users/c831172d6f334c29bd05f93c0d944967/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:35.291392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.291683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.292025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.328029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] MFA Rules not processed for user `c831172d6f334c29bd05f93c0d944967`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:35.329518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:35.334638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:35.336052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:35.427623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 820/1625] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:35.437984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.438416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 806/1626] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 12 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:35.448004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:35.480357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0ab14-326d-4c2f-b5f4-0f9e8fb03cb8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.489946 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cc0f3-0f65-427a-ab5d-0fee17054c20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.491033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc0f3-0f65-427a-ab5d-0fee17054c20 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.492807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc0f3-0f65-427a-ab5d-0fee17054c20 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.493590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc0f3-0f65-427a-ab5d-0fee17054c20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.516450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83506bcf-7881-4ccf-9e3a-74904f9c935a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:35.522581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ccbb6-6f3f-4d16-bdf9-cae8edac6dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:35.523516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ccbb6-6f3f-4d16-bdf9-cae8edac6dbe service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.523953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ccbb6-6f3f-4d16-bdf9-cae8edac6dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.524331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ccbb6-6f3f-4d16-bdf9-cae8edac6dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.538435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ccbb6-6f3f-4d16-bdf9-cae8edac6dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.541479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ccbb6-6f3f-4d16-bdf9-cae8edac6dbe service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.552645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:35.571025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 821/1627] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:49:35.625597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cc0f3-0f65-427a-ab5d-0fee17054c20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:35.627238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cc0f3-0f65-427a-ab5d-0fee17054c20 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:35.643184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 807/1628] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:35.913699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccc86-9918-466c-82d7-380cac5fc3a7 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.914692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccc86-9918-466c-82d7-380cac5fc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.915127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccc86-9918-466c-82d7-380cac5fc3a7 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.917255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 822/1629] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 12 11:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:35.924658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:35.924958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:35.925369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:35.973817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:35.975373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:35.987941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 808/1630] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:36.000439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ccc86-9918-466c-82d7-380cac5fc3a7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:36.013209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ccc86-9918-466c-82d7-380cac5fc3a7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:36.024667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dcca3-eb8d-4930-9211-d2a5c9aa4eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:36.025456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dcca3-eb8d-4930-9211-d2a5c9aa4eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:36.026026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dcca3-eb8d-4930-9211-d2a5c9aa4eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:36.026419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dcca3-eb8d-4930-9211-d2a5c9aa4eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:36.043133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dcca3-eb8d-4930-9211-d2a5c9aa4eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:36.045645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dcca3-eb8d-4930-9211-d2a5c9aa4eb7 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:36.053065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:36.062325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 823/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:36.375369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:36.533469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03353c47-511a-41d0-ac94-5164c9cfcd3d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:36.546703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:36.547395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:36.547715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:36.548179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] PATH_INFO: `/v3/users/48918266672f4b67804708b320c1e0b6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:36.552125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48918266672f4b67804708b320c1e0b6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:36.553253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: WARNING py.warnings [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:49:36.553253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: warnings.warn(msg) Aug 12 11:49:36.553253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: Aug 12 11:49:36.555451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:36.639418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48918266672f4b67804708b320c1e0b6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:36.647759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48918266672f4b67804708b320c1e0b6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:36.674431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48918266672f4b67804708b320c1e0b6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:36.691699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48918266672f4b67804708b320c1e0b6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:36.692750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48918266672f4b67804708b320c1e0b6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:36.708600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 809/1632] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:49:36 2022] DELETE /identity/v3/users/48918266672f4b67804708b320c1e0b6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:36.712242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6248-baaa-45b1-87e1-79ff38ceae91 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:36.713150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6248-baaa-45b1-87e1-79ff38ceae91 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:36.713660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6248-baaa-45b1-87e1-79ff38ceae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:36.736318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cb3d6248-baaa-45b1-87e1-79ff38ceae91 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:36.737851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cb3d6248-baaa-45b1-87e1-79ff38ceae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:36.859994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 824/1633] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:36.939457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:36.941484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:37.157129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ce81-3d63-4d4f-9277-fd487f09493a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:37.157129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38884c46-0473-4bfe-b55e-bd627a023998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:37.157129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38884c46-0473-4bfe-b55e-bd627a023998 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:37.157129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38884c46-0473-4bfe-b55e-bd627a023998 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:37.169792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38884c46-0473-4bfe-b55e-bd627a023998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:37.169792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:37.169792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38884c46-0473-4bfe-b55e-bd627a023998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:37.169792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38884c46-0473-4bfe-b55e-bd627a023998 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:37.169792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 810/1634] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:37.340597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baed8e3-365f-4b47-97c6-ce01d0941db0 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:37.340900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baed8e3-365f-4b47-97c6-ce01d0941db0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:37.341217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baed8e3-365f-4b47-97c6-ce01d0941db0 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:37.343375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 825/1635] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 12 11:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:37.353524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033f26-5772-430f-bde0-e4729b816b72 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:37.354082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033f26-5772-430f-bde0-e4729b816b72 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:37.354519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033f26-5772-430f-bde0-e4729b816b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:37.385848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3c033f26-5772-430f-bde0-e4729b816b72 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:37.388417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3c033f26-5772-430f-bde0-e4729b816b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:37.478001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 811/1636] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 12 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:37.479163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981420-759a-4667-b38d-55c000196611 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:37.479454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981420-759a-4667-b38d-55c000196611 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:37.480178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981420-759a-4667-b38d-55c000196611 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:37.481454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 826/1637] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 12 11:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:37.486851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:37.487436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:37.487941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:37.512433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:37.513651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:37.523808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 812/1638] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:37.539384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981420-759a-4667-b38d-55c000196611 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:37.541603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-00981420-759a-4667-b38d-55c000196611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:37.679469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981420-759a-4667-b38d-55c000196611 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:37.690205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d2c2-91e5-4e0d-bc9b-e1b08916dcb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:37.691279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d2c2-91e5-4e0d-bc9b-e1b08916dcb6 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:37.691776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d2c2-91e5-4e0d-bc9b-e1b08916dcb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:37.692324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d2c2-91e5-4e0d-bc9b-e1b08916dcb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:37.707796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d2c2-91e5-4e0d-bc9b-e1b08916dcb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:37.711708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d2c2-91e5-4e0d-bc9b-e1b08916dcb6 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:37.731338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 827/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:39.514514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:39.516037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:39.535467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde3661-698e-4994-b787-0060f74a1d8f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:39.542206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:39.546411 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:39.546981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:39.547413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] PATH_INFO: `/v3/projects/21becf9fae12443c85cd1605e1fd82d1` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:39.549051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21becf9fae12443c85cd1605e1fd82d1)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:39.551248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:39.597518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:39.598012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:39.598092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:39.688853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] MFA Rules not processed for user `d140838d037a4f698a46516fccdebc96`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:39.691099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:39.719548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21becf9fae12443c85cd1605e1fd82d1', 'request_id': 'req-fe1e65ea-006e-4370-bf3a-58254e50ea82'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:39.735379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21becf9fae12443c85cd1605e1fd82d1', 'request_id': 'req-fe1e65ea-006e-4370-bf3a-58254e50ea82'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:39.758015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21becf9fae12443c85cd1605e1fd82d1', 'request_id': 'req-fe1e65ea-006e-4370-bf3a-58254e50ea82'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:39.775364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] The token cache is being invalidate because project 21becf9fae12443c85cd1605e1fd82d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:49:39.776959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:39.779937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:39.784113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 813/1640] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:49:39 2022] DELETE /identity/v3/projects/21becf9fae12443c85cd1605e1fd82d1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:49:39.791303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:39.801182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:39.880294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 828/1641] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:39 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:39.888831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:39.892481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:40.011318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:40.041178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e65ea-006e-4370-bf3a-58254e50ea82 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.049479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.050444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.051325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.052039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] PATH_INFO: `/v3/users/c831172d6f334c29bd05f93c0d944967` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.057758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c831172d6f334c29bd05f93c0d944967)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.060433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.066669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:40.115686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33298a43-09e4-4768-b45e-a8d6b05c7ebb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.132231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.136689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.137183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.137701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.139523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.141792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.174013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c831172d6f334c29bd05f93c0d944967'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.192651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c831172d6f334c29bd05f93c0d944967'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.229633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 829/1642] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:39 2022] POST /identity/v3/projects => generated 405 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:40.230234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c831172d6f334c29bd05f93c0d944967'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.233954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:40.245366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c831172d6f334c29bd05f93c0d944967'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.246905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c831172d6f334c29bd05f93c0d944967'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.261830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 814/1643] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:49:39 2022] DELETE /identity/v3/users/c831172d6f334c29bd05f93c0d944967 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:49:40.352635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec827e-bf4b-4f68-ae70-fb1e1235d672 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.423123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.423989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.424376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.424824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.425629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.428160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.486552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 830/1644] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:40 2022] POST /identity/v3/users => generated 309 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:40.490846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:40.493771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:40.515999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51402543-a130-494c-92e8-b3614cc4d3fb admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.529544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:40.531995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:40.543928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.547185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.548351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.549877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.550783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.555817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339ecfe-4ce6-4a16-8a5e-edc3a7c3a0b0 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.557252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.568226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.569508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.571385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.572488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] PATH_INFO: `/v3/users/57a862085cc6454792ee6eeb7e66db1d` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.574637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a862085cc6454792ee6eeb7e66db1d)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.576865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.584328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 815/1645] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:40.590183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:40.616139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266460b-e3a8-41bb-823e-5d0edc87cdaf admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.629686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.630582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.630837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.630944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] PATH_INFO: `/v3/projects/f4a0bf41df634c018a032376fbebdd2f/users/4f1fd7c47acd458e8c56dc0d9e12d66b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.669957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a0bf41df634c018a032376fbebdd2f, user_id=4f1fd7c47acd458e8c56dc0d9e12d66b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.672813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.676633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a862085cc6454792ee6eeb7e66db1d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.680706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:40.705269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a862085cc6454792ee6eeb7e66db1d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.712037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 816/1646] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:40 2022] PUT /identity/v3/projects/f4a0bf41df634c018a032376fbebdd2f/users/4f1fd7c47acd458e8c56dc0d9e12d66b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:49:40.715749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:40.732457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a862085cc6454792ee6eeb7e66db1d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.750812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a862085cc6454792ee6eeb7e66db1d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.752200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-842c2180-df64-4b13-b7f1-b7dc8afd5b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a862085cc6454792ee6eeb7e66db1d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:40.762163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 831/1647] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:49:40 2022] DELETE /identity/v3/users/57a862085cc6454792ee6eeb7e66db1d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:40.771065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.771542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.771912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.798025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:40.799868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:40.845158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb19739-0e70-4840-bd0a-617c0961184f admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:40.888156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 832/1648] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:40.926546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:40.941734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:40.943641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:40.945398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:40.946022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:40.947458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:40.954232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:40.973986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 817/1649] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:49:40.978836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:40.980903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:41.004014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:41.008342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:41.017182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc92836-90a4-423d-b705-96683ae75f4a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:41.031267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:41.032624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:41.036995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:41.037546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] PATH_INFO: `/v3/projects/f4a0bf41df634c018a032376fbebdd2f/users/4f1fd7c47acd458e8c56dc0d9e12d66b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:41.041598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a0bf41df634c018a032376fbebdd2f, user_id=4f1fd7c47acd458e8c56dc0d9e12d66b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:41.047904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:41.079799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 833/1650] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:40 2022] PUT /identity/v3/projects/f4a0bf41df634c018a032376fbebdd2f/users/4f1fd7c47acd458e8c56dc0d9e12d66b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:41.134785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e662d5-f32a-444e-915e-ae49b2213fd5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:41.210485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93101aa-8d94-4b59-82dd-9136e483a6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:41.212087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93101aa-8d94-4b59-82dd-9136e483a6ec service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:41.212384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93101aa-8d94-4b59-82dd-9136e483a6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:41.212660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93101aa-8d94-4b59-82dd-9136e483a6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:41.315878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93101aa-8d94-4b59-82dd-9136e483a6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:41.317965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93101aa-8d94-4b59-82dd-9136e483a6ec service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:41.337761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 818/1651] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:42.197042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:42.199210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:42.222438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c8b7-bdda-4371-b821-a6d3cf064f65 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:42.233864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:42.235071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:42.235481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:42.235963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] PATH_INFO: `/v3/projects/fbfcc528ba204d638e0e43112b5db6ee` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:42.237270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfcc528ba204d638e0e43112b5db6ee)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:42.239550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: WARNING py.warnings [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:49:42.239550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: warnings.warn(msg) Aug 12 11:49:42.239550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: Aug 12 11:49:42.241235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:42.493097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfcc528ba204d638e0e43112b5db6ee', 'request_id': 'req-92936dfb-8df8-42d2-a3a7-1882c679f214'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:42.584689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfcc528ba204d638e0e43112b5db6ee', 'request_id': 'req-92936dfb-8df8-42d2-a3a7-1882c679f214'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:42.622268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfcc528ba204d638e0e43112b5db6ee', 'request_id': 'req-92936dfb-8df8-42d2-a3a7-1882c679f214'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:42.716789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] The token cache is being invalidate because project fbfcc528ba204d638e0e43112b5db6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:49:42.717382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:42.719548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-92936dfb-8df8-42d2-a3a7-1882c679f214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:42.725087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 834/1652] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:49:42 2022] DELETE /identity/v3/projects/fbfcc528ba204d638e0e43112b5db6ee => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:42.732929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362585-7103-4708-99f0-63f870256760 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:42.733487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362585-7103-4708-99f0-63f870256760 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:42.734850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362585-7103-4708-99f0-63f870256760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:42.818340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-37362585-7103-4708-99f0-63f870256760 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:42.825574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-37362585-7103-4708-99f0-63f870256760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:42.939837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:42.975703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 819/1653] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:42.977888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:42.978174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:42.978449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.016023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:43.017252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:43.051685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 835/1654] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:43.053388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362585-7103-4708-99f0-63f870256760 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:43.075642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362585-7103-4708-99f0-63f870256760 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:43.087288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:43.088185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.089331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.089614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.090281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:43.090562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:43.094456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:43.135494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 820/1655] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:43.137789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:43.175710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791b6d5-6478-4abc-a295-2d519a1cea3d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:43.211429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:43.213407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.214129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.214586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.215627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:43.219709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:43.325038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 836/1656] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:43 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:43.328970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:43.341878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f116323-6861-4604-b5d1-ac1bc84f3752 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:43.495367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:43.496582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.496582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.496934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.497688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:43.502912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:43.562722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 821/1657] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:43 2022] POST /identity/v3/users => generated 281 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:43.565970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:43.580481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3052-7bdc-4872-8735-3aba5cb16ef8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:43.592620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:43.593370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.593751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.594111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.594937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:43.596691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:43.609634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:43.634898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:43.640332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 837/1658] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:43.653055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0c84c-a0fd-4993-9d14-200314b1a65c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:43.661427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dd4f0-9656-472b-a508-3f92e218a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:43.661627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dd4f0-9656-472b-a508-3f92e218a955 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.662112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dd4f0-9656-472b-a508-3f92e218a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.662404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dd4f0-9656-472b-a508-3f92e218a955 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.663206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dd4f0-9656-472b-a508-3f92e218a955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:43.667449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dd4f0-9656-472b-a508-3f92e218a955 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:43.697660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 822/1659] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:49:43.699482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:43.716692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc100-3184-41fc-ae06-04e8ac77d388 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:43.734760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:43.735646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.735758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.735978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] PATH_INFO: `/v3/projects/3ee26ff7e9a74f4ea3f7e0a216f49751/users/3078f710c34b4fb09a495688b2682ff5/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.765298 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee26ff7e9a74f4ea3f7e0a216f49751, user_id=3078f710c34b4fb09a495688b2682ff5, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:43.768231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:43.815129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 838/1660] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:43 2022] PUT /identity/v3/projects/3ee26ff7e9a74f4ea3f7e0a216f49751/users/3078f710c34b4fb09a495688b2682ff5/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:43.817213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:43.817733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:43.817959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:43.893003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] MFA Rules not processed for user `3078f710c34b4fb09a495688b2682ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:43.908432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:44.045960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 823/1661] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:44.050594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:44.202032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288a1ec-9afe-476d-8d53-9894537d0e2a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:44.224173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:44.224896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:44.225257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:44.225610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:44.226602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:44.228685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:44.318520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 839/1662] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:44 2022] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:44.320079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:44.359694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40313-e2a2-47fb-8c9b-59df47cfd9f7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:44.547628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:44.581784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:44.583660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:44.593672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:44.594489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:44.594938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:44.595342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:44.596316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:44.598818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:44.609823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995925ff-8302-4acb-a591-8d71a96302fd admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:44.636616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:44.637673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:44.638376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:44.638906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] PATH_INFO: `/v3/projects/d95cca31d0b74726995cc29a83582883` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:44.641276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95cca31d0b74726995cc29a83582883)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:44.643474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:44.643881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 824/1663] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:44 2022] POST /identity/v3/users => generated 288 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:49:44.647779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:44.689757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0f3c4-9697-44b0-9922-88e41084c9bd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:44.697644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:44.698557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:44.700780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:44.701211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:44.702069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:44.705118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:44.735138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95cca31d0b74726995cc29a83582883', 'request_id': 'req-62a853ce-7f65-432c-884b-9cd65d7b4c22'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:44.753498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 825/1664] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:44.757833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:44.764729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95cca31d0b74726995cc29a83582883', 'request_id': 'req-62a853ce-7f65-432c-884b-9cd65d7b4c22'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:44.777319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7e721-dd5f-4cc7-8abb-d2c7b46d5e86 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:44.799389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95cca31d0b74726995cc29a83582883', 'request_id': 'req-62a853ce-7f65-432c-884b-9cd65d7b4c22'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:44.844127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] The token cache is being invalidate because project d95cca31d0b74726995cc29a83582883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:49:44.844602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:44.845457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-62a853ce-7f65-432c-884b-9cd65d7b4c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:44.849844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 840/1665] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:49:44 2022] DELETE /identity/v3/projects/d95cca31d0b74726995cc29a83582883 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:49:44.855510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd56e5d-0fac-401b-aed2-a5b47c5c2c83 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:44.855973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd56e5d-0fac-401b-aed2-a5b47c5c2c83 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:44.856385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd56e5d-0fac-401b-aed2-a5b47c5c2c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:44.906469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1dd56e5d-0fac-401b-aed2-a5b47c5c2c83 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:44.907831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1dd56e5d-0fac-401b-aed2-a5b47c5c2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:44.957659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:44.958345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:44.959929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:44.959929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] PATH_INFO: `/v3/projects/2cf3f552089844adaa1bfaeacce48748/users/33188fdd0bff46c2968f66fbbe1d0a3d/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.002219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf3f552089844adaa1bfaeacce48748, user_id=33188fdd0bff46c2968f66fbbe1d0a3d, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:45.002905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:45.010757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:45.044504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 826/1666] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:44 2022] PUT /identity/v3/projects/2cf3f552089844adaa1bfaeacce48748/users/33188fdd0bff46c2968f66fbbe1d0a3d/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:45.051246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:45.056431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:45.081597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 841/1667] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:45.083221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.083519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.083800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.161330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:45.162553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:45.215611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e86c8-3018-4f89-b44a-b6f401b72db9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:45.230670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa3e37-b3e1-459d-ae4c-60dae9a25295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:45.231436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3e37-b3e1-459d-ae4c-60dae9a25295 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.231897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3e37-b3e1-459d-ae4c-60dae9a25295 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.232262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3e37-b3e1-459d-ae4c-60dae9a25295 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.233071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa3e37-b3e1-459d-ae4c-60dae9a25295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:45.236918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa3e37-b3e1-459d-ae4c-60dae9a25295 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:45.265404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 827/1668] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:45.266934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7476a6b-50b0-4002-9161-be8f2704def7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.267318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7476a6b-50b0-4002-9161-be8f2704def7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.267688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7476a6b-50b0-4002-9161-be8f2704def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.314999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 842/1669] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:45.316925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:45.330724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c7476a6b-50b0-4002-9161-be8f2704def7 None None] MFA Rules not processed for user `4f1fd7c47acd458e8c56dc0d9e12d66b`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:45.335014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c7476a6b-50b0-4002-9161-be8f2704def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:45.341114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc11e-e97b-4f01-83f2-d459fc99ed84 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:45.356507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:45.357776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.358152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.358523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] PATH_INFO: `/v3/projects/2cf3f552089844adaa1bfaeacce48748/users/33188fdd0bff46c2968f66fbbe1d0a3d/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.363309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf3f552089844adaa1bfaeacce48748, user_id=33188fdd0bff46c2968f66fbbe1d0a3d, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:45.369788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:45.396697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 843/1670] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:45 2022] PUT /identity/v3/projects/2cf3f552089844adaa1bfaeacce48748/users/33188fdd0bff46c2968f66fbbe1d0a3d/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:45.399340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:45.408745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:45.463904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 828/1671] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:45.465528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284f391-22ce-4250-a532-31ac0023859c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.465692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284f391-22ce-4250-a532-31ac0023859c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.466066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284f391-22ce-4250-a532-31ac0023859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.530936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1284f391-22ce-4250-a532-31ac0023859c None None] MFA Rules not processed for user `33188fdd0bff46c2968f66fbbe1d0a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:45.536235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1284f391-22ce-4250-a532-31ac0023859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:45.604456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5b90-c37e-4ce1-af1c-f42d58bc76f1 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:45.610462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:45.611309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.611731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.612139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.612937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:45.613404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:45.615900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:45.631837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 844/1672] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:45.638293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:45.667275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c87ca-59e8-4117-9c6c-98601038a780 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:45.678576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:45.680641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.681155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.681648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.682600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:45.688546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:45.700329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 829/1673] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:45.713326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284f391-22ce-4250-a532-31ac0023859c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:45.720792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1284f391-22ce-4250-a532-31ac0023859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:45.762849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 845/1674] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:45 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:45.764061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:45.835777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284f391-22ce-4250-a532-31ac0023859c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:45.889428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:45.935427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4eccd-9578-4faa-9bbe-e5de6f365a33 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:45.948248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:45.949936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.950359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.950792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:45.951532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:45.953759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:45.953951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:45.954945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:45.955360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:45.955787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.008415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 846/1675] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:45 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:46.009647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.016975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:46.031204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0148fc9-6ce3-4115-ac36-fb9dad00bcd2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.044273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.045360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.045360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.045999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.046802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.048639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.065056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 847/1676] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:46.069891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.085950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.087460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.088811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e1b50-9bf7-403c-8b23-1c6277b50d51 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.099141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c02e7-c1cd-410e-9f0f-0fe814590e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.100175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c02e7-c1cd-410e-9f0f-0fe814590e06 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.100595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c02e7-c1cd-410e-9f0f-0fe814590e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.101865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c02e7-c1cd-410e-9f0f-0fe814590e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.103114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c02e7-c1cd-410e-9f0f-0fe814590e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.109446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c02e7-c1cd-410e-9f0f-0fe814590e06 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.113060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 830/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:49:46.129525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 848/1678] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:46.129754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.144955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0dd0-fb67-48a1-9d8d-6d8810e03b90 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.157876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.158667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.158960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.159240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] PATH_INFO: `/v3/projects/1c760f7ec9fe4d05a4431ff78dfe710e/users/ab3c4a4eed5c4f1e8eff76f8b5767f18/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.205910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c760f7ec9fe4d05a4431ff78dfe710e, user_id=ab3c4a4eed5c4f1e8eff76f8b5767f18, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.208650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.237089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 831/1679] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:46 2022] PUT /identity/v3/projects/1c760f7ec9fe4d05a4431ff78dfe710e/users/ab3c4a4eed5c4f1e8eff76f8b5767f18/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:46.248057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.248588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.249059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.253253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.293548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] MFA Rules not processed for user `ab3c4a4eed5c4f1e8eff76f8b5767f18`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:46.294816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:46.325782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091eff2-35d9-4e53-a75b-509946a6509c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.341291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.342588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.343006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.343393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.347713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:46.391491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 849/1680] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:46.396797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.437107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.438846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.460397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 832/1681] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:49:46.527709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f188871-b61b-47da-83e8-9f6bc7769e8d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.537079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.540323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.540617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.540908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.541531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.550687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.615256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 850/1682] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:46 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:46.619392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.637776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a718737-303c-41c2-b9ff-d27053517cdb service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.805928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:46.817195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.819478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.819843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.821542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.822781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.824863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.860263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 833/1683] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:46 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:46.861875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.877506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc5c8-c7a7-49cb-a1cb-2ec328c4e2b8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.891168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.892314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:46.892314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:46.892819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:46.893500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:46.895905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:46.927824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 851/1684] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:49:46.942640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:46.982462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eda4a-cf46-4107-a57e-f7c9812adaaf admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:46.995920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:46.998101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.008561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.010460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] PATH_INFO: `/v3/projects/90180b41561f4492b1a84ca2bce41d31/users/066ae49c123b4d89b1ba339d6ad11e0c/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.064556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90180b41561f4492b1a84ca2bce41d31, user_id=066ae49c123b4d89b1ba339d6ad11e0c, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:47.068138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:47.104438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 834/1685] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:46 2022] PUT /identity/v3/projects/90180b41561f4492b1a84ca2bce41d31/users/066ae49c123b4d89b1ba339d6ad11e0c/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:47.108448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:47.123703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb6221-c5cb-4841-a5c3-8e28f0787725 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:47.143408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:47.218570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d91aea-da4a-4a46-bc2a-1bf6f7269a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:47.219369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91aea-da4a-4a46-bc2a-1bf6f7269a51 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.219778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91aea-da4a-4a46-bc2a-1bf6f7269a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.220154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91aea-da4a-4a46-bc2a-1bf6f7269a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.220967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d91aea-da4a-4a46-bc2a-1bf6f7269a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:47.223034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d91aea-da4a-4a46-bc2a-1bf6f7269a51 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:47.251601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 852/1686] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:49:47.256651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:47.278216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ec0b-4868-44da-90ec-14c9d62f87d7 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:47.285607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c5bcf-62be-4644-ace4-9966ee7f8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:47.286463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c5bcf-62be-4644-ace4-9966ee7f8d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.286875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c5bcf-62be-4644-ace4-9966ee7f8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.287253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c5bcf-62be-4644-ace4-9966ee7f8d68 admin admin] PATH_INFO: `/v3/projects/90180b41561f4492b1a84ca2bce41d31/users/066ae49c123b4d89b1ba339d6ad11e0c/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.289705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c5bcf-62be-4644-ace4-9966ee7f8d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90180b41561f4492b1a84ca2bce41d31, user_id=066ae49c123b4d89b1ba339d6ad11e0c, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:47.292753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c5bcf-62be-4644-ace4-9966ee7f8d68 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:47.310541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 835/1687] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:47 2022] PUT /identity/v3/projects/90180b41561f4492b1a84ca2bce41d31/users/066ae49c123b4d89b1ba339d6ad11e0c/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:47.324156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.324626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.325122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.371051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] MFA Rules not processed for user `066ae49c123b4d89b1ba339d6ad11e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:47.373888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:47.543483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 853/1688] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:47.547864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.548398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.548813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.556248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:47.592439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] MFA Rules not processed for user `72a30400dec14a85889af8d8dd59886e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:47.593964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:47.676466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 836/1689] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:47.685489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eef758-e2f2-4cba-b5a0-fc2e8be71a5d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:47.693857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:47.696099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:47.696627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:47.697370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.697765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.698139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.716975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:47.731162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:47.747629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 854/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:49:47.800321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098134fc-7255-4cfb-a591-fbd31c56d5ba None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:47.808195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf874008-50f4-482c-ba20-ee2c861a9ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:47.809215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf874008-50f4-482c-ba20-ee2c861a9ddb service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.809642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf874008-50f4-482c-ba20-ee2c861a9ddb service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.810107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf874008-50f4-482c-ba20-ee2c861a9ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:47.829160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf874008-50f4-482c-ba20-ee2c861a9ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:47.830809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf874008-50f4-482c-ba20-ee2c861a9ddb service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:47.843450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 837/1691] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:49:47.917363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:47.919131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:47.938729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c927e-9fe1-4999-acb2-3845769a015e service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:47.949379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf302-1c97-4101-a64e-78da2eee41ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:47.950256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf302-1c97-4101-a64e-78da2eee41ef service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:47.950755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf302-1c97-4101-a64e-78da2eee41ef service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:47.951173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf302-1c97-4101-a64e-78da2eee41ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:48.030422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:48.079653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaf302-1c97-4101-a64e-78da2eee41ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:48.081226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaf302-1c97-4101-a64e-78da2eee41ef service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:48.107773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 855/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:49.461921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93061-33da-423f-8607-fd09ed0768f5 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:49.462434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93061-33da-423f-8607-fd09ed0768f5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:49.462709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec93061-33da-423f-8607-fd09ed0768f5 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:49.464903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 838/1693] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:49.506122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:49.506721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:49.506959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:49.547910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:49.553246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:49.709611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 856/1694] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:49.729980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba425f-66b8-4c4e-8294-6d90f61505b4 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:49.730514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba425f-66b8-4c4e-8294-6d90f61505b4 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:49.731032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba425f-66b8-4c4e-8294-6d90f61505b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:49.793146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-beba425f-66b8-4c4e-8294-6d90f61505b4 None None] MFA Rules not processed for user `7d02a90e6cb7428985fe399974b385b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:49.794601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-beba425f-66b8-4c4e-8294-6d90f61505b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:49.815120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:49.982266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 839/1695] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:49.998601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:50.000397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:50.030070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553659c5-62c7-4da0-b5b3-b3bcf17bce61 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:50.030572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553659c5-62c7-4da0-b5b3-b3bcf17bce61 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:50.031092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553659c5-62c7-4da0-b5b3-b3bcf17bce61 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:50.033153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 840/1696] 10.222.0.42 () {54 vars in 961 bytes} [Fri Aug 12 11:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:50.039581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24942f-bcb3-44bb-b8ec-7e638d2232cf None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:50.040183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24942f-bcb3-44bb-b8ec-7e638d2232cf None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:50.040663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24942f-bcb3-44bb-b8ec-7e638d2232cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:50.051915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aadc88-cad2-46ba-8ced-378823ce2207 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:50.061454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:50.062102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:50.062381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:50.062709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:50.087126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:50.088482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4b24942f-bcb3-44bb-b8ec-7e638d2232cf None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:50.089207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:50.090556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4b24942f-bcb3-44bb-b8ec-7e638d2232cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:50.118720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 857/1697] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:50.126220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 841/1698] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Aug 12 11:49:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:50.134359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:50.146560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9e0ff-13a9-4fbe-8d7b-08e181273e66 service nova] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:50.154012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec2fa1-2e88-4b2c-bbf8-96659574e085 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:50.154678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec2fa1-2e88-4b2c-bbf8-96659574e085 service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:50.154967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec2fa1-2e88-4b2c-bbf8-96659574e085 service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:50.155244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec2fa1-2e88-4b2c-bbf8-96659574e085 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:50.167845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec2fa1-2e88-4b2c-bbf8-96659574e085 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:50.169483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec2fa1-2e88-4b2c-bbf8-96659574e085 service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:50.214493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 858/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:52.775973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddc310-050b-4211-aa93-4e45f87dab61 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:52.776818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddc310-050b-4211-aa93-4e45f87dab61 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:52.776818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddc310-050b-4211-aa93-4e45f87dab61 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:52.780001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 842/1700] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:49:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:49:52.843397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:52.845594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:52.846275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:52.938854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] MFA Rules not processed for user `3a3f00cae3d04d2fa79ed4481ce024aa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:52.941971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:52.943218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddc310-050b-4211-aa93-4e45f87dab61 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:52.946384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-50ddc310-050b-4211-aa93-4e45f87dab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:52.964349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 859/1701] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:49:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:52.993649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:53.009241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cb341-688e-462f-952c-941d15ea6f3a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:53.023641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:53.024565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:53.025083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:53.025551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:53.049853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:53.052028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:53.082958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 860/1702] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:49:53.145948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddc310-050b-4211-aa93-4e45f87dab61 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:53.151732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:53.152794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:53.153252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:53.153704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] PATH_INFO: `/v3/users/d140838d037a4f698a46516fccdebc96` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:53.156137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d140838d037a4f698a46516fccdebc96)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:53.158668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:53.239541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd140838d037a4f698a46516fccdebc96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:53.258288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd140838d037a4f698a46516fccdebc96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:53.284751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd140838d037a4f698a46516fccdebc96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:53.322922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd140838d037a4f698a46516fccdebc96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:53.323992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6e6cb107-1b4e-49de-845d-1b10d63fdc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd140838d037a4f698a46516fccdebc96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:53.332725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 843/1703] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:49:52 2022] DELETE /identity/v3/users/d140838d037a4f698a46516fccdebc96 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:49:53.951851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:53.989449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4e31-4a06-487e-8a7b-320e27a89668 service placement] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:54.160353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:54.161267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:54.161692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:54.162106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] PATH_INFO: `/v3/projects/a5add51853d04cd7835169b94db2862a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:54.164708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5add51853d04cd7835169b94db2862a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:54.172446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:54.337833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:54.399517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbfda5-5681-427f-b7dc-aa7bda7c616a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:54.401616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbfda5-5681-427f-b7dc-aa7bda7c616a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:54.403788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbfda5-5681-427f-b7dc-aa7bda7c616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:54.418350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5add51853d04cd7835169b94db2862a', 'request_id': 'req-dc076461-393f-40c3-847a-2b3145378564'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:54.458404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5add51853d04cd7835169b94db2862a', 'request_id': 'req-dc076461-393f-40c3-847a-2b3145378564'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:54.491245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5add51853d04cd7835169b94db2862a', 'request_id': 'req-dc076461-393f-40c3-847a-2b3145378564'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:54.500399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-45fbfda5-5681-427f-b7dc-aa7bda7c616a None None] MFA Rules not processed for user `72a30400dec14a85889af8d8dd59886e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:54.505173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-45fbfda5-5681-427f-b7dc-aa7bda7c616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:54.560371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] The token cache is being invalidate because project a5add51853d04cd7835169b94db2862a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:49:54.561366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:54.564868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:54.581791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 861/1704] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:49:53 2022] DELETE /identity/v3/projects/a5add51853d04cd7835169b94db2862a => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:54.588169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:54.592987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:54.623698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:54.877602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 844/1705] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:54.987100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc076461-393f-40c3-847a-2b3145378564 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:54.994216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:54.995127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:54.995582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:54.996026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] PATH_INFO: `/v3/users/4f1fd7c47acd458e8c56dc0d9e12d66b` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:54.997561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1fd7c47acd458e8c56dc0d9e12d66b)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:55.011954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:55.152117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1fd7c47acd458e8c56dc0d9e12d66b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:55.165538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1fd7c47acd458e8c56dc0d9e12d66b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:55.191021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1fd7c47acd458e8c56dc0d9e12d66b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:55.225255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1fd7c47acd458e8c56dc0d9e12d66b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:55.227979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4e62a7a-6726-425a-9b76-13122e474837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1fd7c47acd458e8c56dc0d9e12d66b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:55.243469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 862/1706] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:49:54 2022] DELETE /identity/v3/users/4f1fd7c47acd458e8c56dc0d9e12d66b => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:56.566263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:56.567203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:56.567713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:56.577924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa373-6d34-4d57-af19-b621441e9b7f None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:56.579094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa373-6d34-4d57-af19-b621441e9b7f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:56.579780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa373-6d34-4d57-af19-b621441e9b7f None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:56.582277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 863/1707] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 12 11:49:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:49:56.590922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82967ba-0bcb-446e-b420-79a3fe1a3685 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:56.591396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82967ba-0bcb-446e-b420-79a3fe1a3685 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:56.592695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82967ba-0bcb-446e-b420-79a3fe1a3685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:56.608879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] MFA Rules not processed for user `7d02a90e6cb7428985fe399974b385b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:56.612537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:56.692881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a82967ba-0bcb-446e-b420-79a3fe1a3685 None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:56.694988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a82967ba-0bcb-446e-b420-79a3fe1a3685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:56.722258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:56.760061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 845/1708] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:56.760061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:56.760061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:56.791517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 864/1709] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:49:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:56.796225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:56.796543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:56.796962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:56.879662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] MFA Rules not processed for user `381f8ca947954e01b6255626d4a2888f`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:56.880940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:56.905179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d052f7-7098-47e8-975c-574a927ca89d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:56.914394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:56.915124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:56.915407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:56.915681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] PATH_INFO: `/v3/projects/f4a0bf41df634c018a032376fbebdd2f` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:56.917817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a0bf41df634c018a032376fbebdd2f)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:56.919904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:57.021529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a0bf41df634c018a032376fbebdd2f', 'request_id': 'req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:57.036437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a0bf41df634c018a032376fbebdd2f', 'request_id': 'req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:57.057992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a0bf41df634c018a032376fbebdd2f', 'request_id': 'req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:57.083006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 865/1710] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:57.083006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:57.086091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.087351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] The token cache is being invalidate because project f4a0bf41df634c018a032376fbebdd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:49:57.088593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:57.090309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e570bdc5-fbfc-485d-8d0d-4cdf9b215f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:49:57.097893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 846/1711] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:49:56 2022] DELETE /identity/v3/projects/f4a0bf41df634c018a032376fbebdd2f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:57.100634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b8a8-28f3-43aa-acc1-a3783282aebd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.103102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b8a8-28f3-43aa-acc1-a3783282aebd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.103459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b8a8-28f3-43aa-acc1-a3783282aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.124324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545003c-ba2e-4d8f-8be1-5719a4257ed1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:57.127735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:57.192764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5ec9b8a8-28f3-43aa-acc1-a3783282aebd None None] MFA Rules not processed for user `134faab760d04e3ba537619281c316c9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:57.200016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5ec9b8a8-28f3-43aa-acc1-a3783282aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.285171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:57.288128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.289243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.289609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.292990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.318224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:57.321642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef329d3-35eb-42ab-9358-0ebd3e631467 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:57.346904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 866/1712] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:57.355124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b99b-8149-4340-8e28-67794b024257 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.356532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b99b-8149-4340-8e28-67794b024257 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.356912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b99b-8149-4340-8e28-67794b024257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.425071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 847/1713] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:57.427171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb249-23b2-4c84-bfd8-14b288d8b748 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.428302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb249-23b2-4c84-bfd8-14b288d8b748 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.429306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb249-23b2-4c84-bfd8-14b288d8b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.436173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-69d5b99b-8149-4340-8e28-67794b024257 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:57.439357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-69d5b99b-8149-4340-8e28-67794b024257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.501416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a2afb249-23b2-4c84-bfd8-14b288d8b748 None None] MFA Rules not processed for user `134faab760d04e3ba537619281c316c9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:57.508297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a2afb249-23b2-4c84-bfd8-14b288d8b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.527083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 848/1714] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:57.639653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 867/1715] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:57.647026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494756b-2ec7-42e8-aaed-004af938d278 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.648760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494756b-2ec7-42e8-aaed-004af938d278 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.650132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494756b-2ec7-42e8-aaed-004af938d278 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.652058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 849/1716] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 12 11:49:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:49:57.654215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.654451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.654855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.661018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.661378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.661724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.678914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:57.716381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:57.718393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.734755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 868/1717] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:57.739284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:57.750416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a02e2-6979-4227-a450-edfbad2c8300 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:57.762505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:57.763042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.763319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.763589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.764510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:49:57.764917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:57.765975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:57.766661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:57.768526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.801485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 850/1718] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:57.806898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 869/1719] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:49:57.811470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:57.826147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:57.828466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:57.833788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f65d22-66ad-4b75-98db-02c9080f6c3b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:57.846265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c443d2a-71a7-4140-a937-0c3be36ddd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:57.847470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443d2a-71a7-4140-a937-0c3be36ddd56 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.847836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443d2a-71a7-4140-a937-0c3be36ddd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.848771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443d2a-71a7-4140-a937-0c3be36ddd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.849613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2186-345d-4a00-8127-38acf5c5c63d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:57.865351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443d2a-71a7-4140-a937-0c3be36ddd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:57.865801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:57.866433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:57.867480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:57.867757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:57.870664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443d2a-71a7-4140-a937-0c3be36ddd56 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:57.886661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:57.890838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:57.929705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 870/1720] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:57.934082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 851/1721] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:57.938052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:57.964518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1dd0-3da5-426a-95f3-cc27282a11f6 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:58.013165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3e05d-16c5-4244-80da-33ea58177ad7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.013698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3e05d-16c5-4244-80da-33ea58177ad7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.014539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3e05d-16c5-4244-80da-33ea58177ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.081378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-46b3e05d-16c5-4244-80da-33ea58177ad7 None None] MFA Rules not processed for user `64ec7445644e478ca961be80f84f9863`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:58.082908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-46b3e05d-16c5-4244-80da-33ea58177ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:58.097035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:58.097788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.098162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.099084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.099815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:58.104912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:58.187274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 871/1722] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:57 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:58.192779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.224602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8b160-9146-466d-a9c0-818b4d908f4d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:58.235697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:58.244806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.245476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.245476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.246033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:58.264593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:58.283581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 852/1723] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:49:58.301596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2025d-5692-41ab-91b8-6e14e0da6b6a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.302961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2025d-5692-41ab-91b8-6e14e0da6b6a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.303920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 872/1724] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:58.304339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2025d-5692-41ab-91b8-6e14e0da6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.309257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.330838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c071d-eee7-4eaa-bba0-30362a0aee66 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:58.347729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:58.348683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.349310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.349895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.350675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:58.353123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:58.377506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 873/1725] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:58.379154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-63f2025d-5692-41ab-91b8-6e14e0da6b6a None None] MFA Rules not processed for user `64ec7445644e478ca961be80f84f9863`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:58.382445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-63f2025d-5692-41ab-91b8-6e14e0da6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:58.382911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.412050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 853/1726] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:58.422898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6a228-18ef-4619-bfa8-068580904614 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:58.435319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:58.436177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.436598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.437048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] PATH_INFO: `/v3/projects/a24c42ba026d46499d00c8dd471cd867/users/bcda49fc4c46494aa632f2e6e3af6ec5/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.472586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24c42ba026d46499d00c8dd471cd867, user_id=bcda49fc4c46494aa632f2e6e3af6ec5, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:58.475781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:58.504839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 874/1727] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:58 2022] PUT /identity/v3/projects/a24c42ba026d46499d00c8dd471cd867/users/bcda49fc4c46494aa632f2e6e3af6ec5/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:58.519005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.519291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.519614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.543018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.548039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:58.560550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] MFA Rules not processed for user `bcda49fc4c46494aa632f2e6e3af6ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:49:58.561938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:58.599488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:58.686962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 854/1728] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:49:58.690590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.797677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac106f-5c14-4b2d-920f-8100d0361ff6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:58.815074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:58.816146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.816598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.817084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.821480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:58.842357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e9b2-1c66-443b-acfa-f7cc85e8fcd1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:58.844047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:58.849778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:58.850370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:58.850978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:58.851336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:58.855803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:58.858449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:58.954809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:58.959951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 855/1729] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:49:58 2022] POST /identity/v3/projects => generated 379 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:58.961994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.967286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:58.968346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:58.981880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 875/1730] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:58.984199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:58.985815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:59.046164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d136fcb-f431-4664-8fee-9508a3d951c8 service nova] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.162918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.164667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.165989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.166693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.181138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee998329-e91e-429d-b1c2-403f547f6af0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.204629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.205344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.210007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.210395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.217655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:59.234707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.237042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.248520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 876/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:59.249566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.254959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.259743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.285992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 856/1732] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:59.287015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.290760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:49:59.326255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f4571-a922-4997-97f2-7c8e6a7fef6f service placement] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.339942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.340953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.341479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.341905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.349399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:59.371430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc0c9-5843-4185-82a2-5c3976dae737 service nova] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.378394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.378905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.379278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.379651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.380456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.388681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.389473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.401302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.426976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 857/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:59.428674 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 877/1734] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:49:59 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:49:59.433833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.435197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.455716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92cc6-2627-4854-8a79-5ee6e93ad38a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.457523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7c7fb-6920-4b78-b9ce-7efb5ca8837a service placement] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.465053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.465669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.465948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.466221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.467414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.470135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.473381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.474075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.474357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.474654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.504238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 878/1735] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:59.505255 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.529337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96989a-2916-4e03-b1db-c8d7dcb391a5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.541408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.542151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.543380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.543755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] PATH_INFO: `/v3/projects/43b91664dc214164b5df82fc0c7465bd/users/fdbda63b688246d2966de1d43c21d8f3/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.556281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:49:59.583206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b91664dc214164b5df82fc0c7465bd, user_id=fdbda63b688246d2966de1d43c21d8f3, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.585940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.619282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 879/1736] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:59 2022] PUT /identity/v3/projects/43b91664dc214164b5df82fc0c7465bd/users/fdbda63b688246d2966de1d43c21d8f3/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:49:59.625899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.629872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.632893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.667228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 858/1737] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:49:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:49:59.846690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754f8e-5a36-4a54-903c-b8ec87588aad admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.868529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe3b5-b770-4548-8457-2bff1ac2a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.869479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe3b5-b770-4548-8457-2bff1ac2a43c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.869738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe3b5-b770-4548-8457-2bff1ac2a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.870024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe3b5-b770-4548-8457-2bff1ac2a43c admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.870702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe3b5-b770-4548-8457-2bff1ac2a43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.874018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe3b5-b770-4548-8457-2bff1ac2a43c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.912898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 880/1738] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:49:59.917651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:49:59.933556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9909d2-1919-4266-bc34-3b365975855b service nova] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:49:59.949302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:49:59.950011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.950295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.950569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] PATH_INFO: `/v3/projects/43b91664dc214164b5df82fc0c7465bd/users/fdbda63b688246d2966de1d43c21d8f3/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:49:59.956339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b91664dc214164b5df82fc0c7465bd, user_id=fdbda63b688246d2966de1d43c21d8f3, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:49:59.959079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:49:59.985426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 859/1739] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:49:59 2022] PUT /identity/v3/projects/43b91664dc214164b5df82fc0c7465bd/users/fdbda63b688246d2966de1d43c21d8f3/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:49:59.987247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:49:59.987534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:49:59.987859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:00.021698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] MFA Rules not processed for user `fdbda63b688246d2966de1d43c21d8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:00.025017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:00.192620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 881/1740] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:49:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:00.208004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:00.220665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:00.375028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b8be6-ac46-4125-a579-cfda70735aff admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:00.383702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010f4e8-375b-43ec-aa47-e9b3b2f0634b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:00.384399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f4e8-375b-43ec-aa47-e9b3b2f0634b service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:00.384689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f4e8-375b-43ec-aa47-e9b3b2f0634b service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:00.384963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f4e8-375b-43ec-aa47-e9b3b2f0634b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:00.396273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010f4e8-375b-43ec-aa47-e9b3b2f0634b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:00.399215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010f4e8-375b-43ec-aa47-e9b3b2f0634b service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:00.431042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 860/1741] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:00.621603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:00.636144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af482b68-07d3-4d91-a4ac-476ea81d5140 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:00.641687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84767-c75d-42e7-99d7-a1168663a84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:00.642964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84767-c75d-42e7-99d7-a1168663a84e service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:00.643506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84767-c75d-42e7-99d7-a1168663a84e service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:00.644240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84767-c75d-42e7-99d7-a1168663a84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:00.691077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:00.782508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84767-c75d-42e7-99d7-a1168663a84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:00.782508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84767-c75d-42e7-99d7-a1168663a84e service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:00.806575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 882/1742] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:02.750959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:02.752010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:02.752219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:02.853166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] MFA Rules not processed for user `381f8ca947954e01b6255626d4a2888f`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:02.855913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:02.993001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe60af-ca05-4f24-9d64-ab98a7d69d65 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:02.996153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe60af-ca05-4f24-9d64-ab98a7d69d65 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:02.996580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe60af-ca05-4f24-9d64-ab98a7d69d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:03.028366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2dbe60af-ca05-4f24-9d64-ab98a7d69d65 None None] MFA Rules not processed for user `64ec7445644e478ca961be80f84f9863`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:03.029982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2dbe60af-ca05-4f24-9d64-ab98a7d69d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:03.084756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 861/1743] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:03.231065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 883/1744] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:03.848468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:03.851044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:04.011818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc8f98-4678-439a-875d-cd3731a92d18 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:04.032963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:04.034546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:04.035069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:04.035485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] PATH_INFO: `/v3/users/3078f710c34b4fb09a495688b2682ff5` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:04.051401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3078f710c34b4fb09a495688b2682ff5)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:04.053749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:04.063871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:04.180612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3078f710c34b4fb09a495688b2682ff5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:04.198036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3078f710c34b4fb09a495688b2682ff5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:04.236462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3078f710c34b4fb09a495688b2682ff5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:04.261195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3078f710c34b4fb09a495688b2682ff5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:04.264253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3078f710c34b4fb09a495688b2682ff5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:04.284846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 862/1745] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:03 2022] DELETE /identity/v3/users/3078f710c34b4fb09a495688b2682ff5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:04.286010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15484f2-2c93-4d62-a58c-ccefc93c4049 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:04.286495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15484f2-2c93-4d62-a58c-ccefc93c4049 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:04.286584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15484f2-2c93-4d62-a58c-ccefc93c4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:04.359129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e15484f2-2c93-4d62-a58c-ccefc93c4049 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:04.360791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e15484f2-2c93-4d62-a58c-ccefc93c4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:04.453040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 884/1746] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:04.486212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:04.488067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:04.579794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:04.580082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:04.581116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:04.707259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5615686-0153-4f2e-bb39-05e03b1e1bfb admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:04.735924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:04.736572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:04.736853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:04.737424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:04.777742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:04.782159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:04.788658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:04.795001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:04.838722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 863/1747] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:04.856111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:04.919169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 885/1748] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:50:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:05.256139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:05.258252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:05.529097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3ff4-a01d-49ac-abd6-bc323045c484 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:05.541063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:05.541943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:05.542319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:05.542662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:05.567997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:05.570279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:05.575161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:05.584365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 864/1749] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:50:07.902587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:07.904057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:07.933325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe7a24-90ee-43e1-9137-eb148905c672 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:07.942742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:07.943721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:07.943887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:07.944249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] PATH_INFO: `/v3/projects/3ee26ff7e9a74f4ea3f7e0a216f49751` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:07.946948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee26ff7e9a74f4ea3f7e0a216f49751)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:07.949021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:08.064838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee26ff7e9a74f4ea3f7e0a216f49751', 'request_id': 'req-caa190f0-07ce-40a2-94bb-d05c3cf1f418'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.077895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee26ff7e9a74f4ea3f7e0a216f49751', 'request_id': 'req-caa190f0-07ce-40a2-94bb-d05c3cf1f418'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.097958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee26ff7e9a74f4ea3f7e0a216f49751', 'request_id': 'req-caa190f0-07ce-40a2-94bb-d05c3cf1f418'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.152280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] The token cache is being invalidate because project 3ee26ff7e9a74f4ea3f7e0a216f49751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:08.170873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.171739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-caa190f0-07ce-40a2-94bb-d05c3cf1f418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.179058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:08.179715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 886/1750] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:07 2022] DELETE /identity/v3/projects/3ee26ff7e9a74f4ea3f7e0a216f49751 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:08.205923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfe9b0-a2c1-45a7-b4b2-50cab00c9fd3 service swift] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:08.437853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:08.438524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:08.438837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:08.439111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] PATH_INFO: `/v3/users/33188fdd0bff46c2968f66fbbe1d0a3d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:08.451588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33188fdd0bff46c2968f66fbbe1d0a3d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:08.453788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:08.498741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:08.499085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:08.499373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:08.539355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:08.540989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:08.643436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33188fdd0bff46c2968f66fbbe1d0a3d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.673798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33188fdd0bff46c2968f66fbbe1d0a3d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.715634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33188fdd0bff46c2968f66fbbe1d0a3d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.763472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33188fdd0bff46c2968f66fbbe1d0a3d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.788121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33188fdd0bff46c2968f66fbbe1d0a3d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:08.793974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 887/1751] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 12 11:50:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:08.814841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 865/1752] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:08 2022] DELETE /identity/v3/users/33188fdd0bff46c2968f66fbbe1d0a3d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:08.815812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:08.817532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:08.831114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:08.847210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674325-7dcd-4365-95af-ff3502c18768 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:09.033099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:09.033796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:09.034022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:09.034475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:09.052664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:09.057167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:09.079072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 888/1753] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:09.140083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb16d1-33de-4427-b4ec-ee91a85c754d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:09.145788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:09.146482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:09.146992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:09.147429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:09.158122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:09.159962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:09.176219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 866/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:11.518834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:11.520624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:11.571542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:11.754131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeff2d-e115-4dda-8971-1e8cfd2d8e6c service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:11.781881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:11.782549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:11.782857 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:11.783133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] PATH_INFO: `/v3/projects/2cf3f552089844adaa1bfaeacce48748` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:11.786556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf3f552089844adaa1bfaeacce48748)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:11.789203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:11.953415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf3f552089844adaa1bfaeacce48748', 'request_id': 'req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:11.982372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf3f552089844adaa1bfaeacce48748', 'request_id': 'req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.005415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf3f552089844adaa1bfaeacce48748', 'request_id': 'req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.042576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] The token cache is being invalidate because project 2cf3f552089844adaa1bfaeacce48748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:12.048296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.053614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:12.054209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5c313c5c-38ab-4282-b8aa-ff445a3cfe10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.057018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:12.062030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 889/1755] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:11 2022] DELETE /identity/v3/projects/2cf3f552089844adaa1bfaeacce48748 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:12.067212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4f27-269b-4222-9fc0-f334accf7ccc None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:12.069755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4f27-269b-4222-9fc0-f334accf7ccc None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:12.070231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4f27-269b-4222-9fc0-f334accf7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:12.111790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45406ad-b488-4e7d-a8ce-0edfff9b9be1 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:12.160040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e94f4f27-269b-4222-9fc0-f334accf7ccc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:12.162404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e94f4f27-269b-4222-9fc0-f334accf7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:12.238143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:12.377008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:12.377746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:12.378034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:12.378846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] PATH_INFO: `/v3/users/bcda49fc4c46494aa632f2e6e3af6ec5` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:12.379997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 890/1756] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:12.389390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcda49fc4c46494aa632f2e6e3af6ec5)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:12.389800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:12.390306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:12.390764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:12.394196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:12.475014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:12.483086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:12.520592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcda49fc4c46494aa632f2e6e3af6ec5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.540110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 891/1757] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:12.542297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcda49fc4c46494aa632f2e6e3af6ec5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.542729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:12.570475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcda49fc4c46494aa632f2e6e3af6ec5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.592157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcda49fc4c46494aa632f2e6e3af6ec5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.596492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-27aae7d8-e992-4064-b0bb-ff42f42356cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcda49fc4c46494aa632f2e6e3af6ec5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:12.597935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed41c-dd1d-465d-b110-a0854b4104e0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:12.619559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:12.621818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:12.624543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:12.624764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 867/1758] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:12 2022] DELETE /identity/v3/users/bcda49fc4c46494aa632f2e6e3af6ec5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:12.624867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:12.626233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:12.626530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:12.626838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:12.628467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:12.628818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:12.635556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:12.651387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:12.652786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:12.686234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 892/1759] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:12.692065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:12.705966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:12.729752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb6422-6b31-41cb-a776-986495844178 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:12.789627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:12.878987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:12.879809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:12.880172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:12.880477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:12.881384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:12.884264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:12.891536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 868/1760] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:12.949160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:12.960662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 893/1761] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:12 2022] POST /identity/v3/projects => generated 363 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:12.961964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b21f2-9988-4efe-bfd5-5b52225ad36a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:12.966910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:12.971448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:13.093744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:13.153162 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5bed7-f694-41f7-984a-68fd6553b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:13.154396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f12e1-57dc-4b7e-a2ae-f9762d9f5449 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:13.155383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5bed7-f694-41f7-984a-68fd6553b9ed admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.155991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5bed7-f694-41f7-984a-68fd6553b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.157254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5bed7-f694-41f7-984a-68fd6553b9ed admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.172759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5bed7-f694-41f7-984a-68fd6553b9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:13.178281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5bed7-f694-41f7-984a-68fd6553b9ed admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:13.181634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:13.184964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.185634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.187711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.241723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:13.244575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:13.281172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 869/1762] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:12 2022] POST /identity/v3/users => generated 282 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:13.287893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c64e-1573-4d1f-b5a3-fd4677652e02 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.290280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 894/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:13.293553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c64e-1573-4d1f-b5a3-fd4677652e02 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.294183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:13.294653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c64e-1573-4d1f-b5a3-fd4677652e02 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.307511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 870/1764] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:50:13 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:50:13.318633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c45fc-442c-4fe1-9e46-aa33a5806b63 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:13.327443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:13.328211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.328609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.329010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.329786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:13.331709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:13.336148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d89c-cb19-4420-8b8a-0f1a83ff6dc6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.336781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d89c-cb19-4420-8b8a-0f1a83ff6dc6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.337078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d89c-cb19-4420-8b8a-0f1a83ff6dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.362103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 895/1765] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:13.363667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:13.373113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-fef0d89c-cb19-4420-8b8a-0f1a83ff6dc6 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:13.375010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fef0d89c-cb19-4420-8b8a-0f1a83ff6dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:13.376472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7964d7-23b0-48bf-8117-ed03e49c7177 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:13.395183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:13.395795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.396140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.396334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.402172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:13.403914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:13.427148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 896/1766] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:13.428387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:13.461260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60fb90-189c-4299-b54b-e1893c4590f1 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:13.480226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:13.481678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.482121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.484337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] PATH_INFO: `/v3/projects/e0fec160d41744668f5e1adb8297b3de/users/d59a58b12566424790ab3428e6e164cd/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.525805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fec160d41744668f5e1adb8297b3de, user_id=d59a58b12566424790ab3428e6e164cd, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:13.531141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:13.540393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 871/1767] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 12 11:50:13.574554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 897/1768] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:13 2022] PUT /identity/v3/projects/e0fec160d41744668f5e1adb8297b3de/users/d59a58b12566424790ab3428e6e164cd/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:13.576755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8642-4552-4045-8329-751856afc734 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:13.577062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8642-4552-4045-8329-751856afc734 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:13.577348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8642-4552-4045-8329-751856afc734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:13.635155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-dc0b8642-4552-4045-8329-751856afc734 None None] MFA Rules not processed for user `d59a58b12566424790ab3428e6e164cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:13.639018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dc0b8642-4552-4045-8329-751856afc734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:13.866803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 872/1769] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:13.871007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:14.084146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e42015-5811-4f9c-9066-9829a85808f3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:14.092000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:14.092714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.093373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.093798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.094444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:14.096779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:14.121645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:14.154975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 898/1770] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:13 2022] POST /identity/v3/projects => generated 363 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:14.158961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8642-4552-4045-8329-751856afc734 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:14.180696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8642-4552-4045-8329-751856afc734 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:14.311488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:14.327627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:14.329523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.332387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.333016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.334535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:14.338382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:14.390455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 873/1771] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:14 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:14.394855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:14.415209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eaee-6c1b-434a-94d1-2658d8fd5abe admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:14.425429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:14.426447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.426948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.427436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.428372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:14.435944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:14.451876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 899/1772] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:14.455869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:14.473473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617092e1-8c43-418e-890c-eb5ecf59dcb5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:14.507556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:14.508911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.509845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.510572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] PATH_INFO: `/v3/projects/3be5a6dca53d48059852d9488beb62c7/users/a015350f5e184d9e9768e52ab2a0fa95/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.561177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be5a6dca53d48059852d9488beb62c7, user_id=a015350f5e184d9e9768e52ab2a0fa95, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:14.563896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:14.588452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 874/1773] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:14 2022] PUT /identity/v3/projects/3be5a6dca53d48059852d9488beb62c7/users/a015350f5e184d9e9768e52ab2a0fa95/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:14.593327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:14.614704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48947-8824-49b5-acb4-d154156e5ef4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:14.711560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f857c15-cf3c-44d8-9ccb-a61537c42f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:14.713078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f857c15-cf3c-44d8-9ccb-a61537c42f5b admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.713355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f857c15-cf3c-44d8-9ccb-a61537c42f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.714273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f857c15-cf3c-44d8-9ccb-a61537c42f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.720309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f857c15-cf3c-44d8-9ccb-a61537c42f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:14.724392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f857c15-cf3c-44d8-9ccb-a61537c42f5b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:14.742079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 900/1774] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:14.744098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:14.781377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59356b7-cee7-4b3e-a15c-c95f30e39d5c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:14.795122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:14.796460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.797601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.797928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] PATH_INFO: `/v3/projects/3be5a6dca53d48059852d9488beb62c7/users/a015350f5e184d9e9768e52ab2a0fa95/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.801899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be5a6dca53d48059852d9488beb62c7, user_id=a015350f5e184d9e9768e52ab2a0fa95, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:14.828590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:14.906739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 875/1775] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:14 2022] PUT /identity/v3/projects/3be5a6dca53d48059852d9488beb62c7/users/a015350f5e184d9e9768e52ab2a0fa95/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:14.911101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:14.911768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:14.912194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:14.986812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] MFA Rules not processed for user `a015350f5e184d9e9768e52ab2a0fa95`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:14.989385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:15.106133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:15.107922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:15.178485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 901/1776] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:15.191478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:15.199865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:15.320970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4785d-39db-4689-a824-442903180a29 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:15.327047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:15.331668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:15.331976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:15.332234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] PATH_INFO: `/v3/projects/a24c42ba026d46499d00c8dd471cd867` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:15.334601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24c42ba026d46499d00c8dd471cd867)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:15.337534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:15.390469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4bd5c-e0ed-4182-aa57-184725290eed None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:15.407777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:15.412695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:15.413682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:15.414153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:15.428680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:15.431178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:15.447652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24c42ba026d46499d00c8dd471cd867', 'request_id': 'req-54118707-cabc-44b6-afa5-40d47f0d2f50'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.456455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24c42ba026d46499d00c8dd471cd867', 'request_id': 'req-54118707-cabc-44b6-afa5-40d47f0d2f50'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.458190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 902/1777] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:15.476827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24c42ba026d46499d00c8dd471cd867', 'request_id': 'req-54118707-cabc-44b6-afa5-40d47f0d2f50'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.531209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] The token cache is being invalidate because project a24c42ba026d46499d00c8dd471cd867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:15.531529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.536727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.545003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 876/1778] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:15 2022] DELETE /identity/v3/projects/a24c42ba026d46499d00c8dd471cd867 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:15.549335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:15.566110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8552-c39c-4dcf-a6c9-f5b057d6593b service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:15.577253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:15.612833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:15.614238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:15.719883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:15.783015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54118707-cabc-44b6-afa5-40d47f0d2f50 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:15.792858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:15.793540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:15.793830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:15.794896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:15.799376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:15.812824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:15.815272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:15.815775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:15.816719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] PATH_INFO: `/v3/users/fdbda63b688246d2966de1d43c21d8f3` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:15.818443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbda63b688246d2966de1d43c21d8f3)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:15.833879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:15.951580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbda63b688246d2966de1d43c21d8f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.962139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbda63b688246d2966de1d43c21d8f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.974706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbda63b688246d2966de1d43c21d8f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.986000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:15.987800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0517fd-ce75-46d3-803d-a62c147a10c1 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:15.996891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbda63b688246d2966de1d43c21d8f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:15.997915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbda63b688246d2966de1d43c21d8f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:16.008102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 903/1779] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:15 2022] DELETE /identity/v3/users/fdbda63b688246d2966de1d43c21d8f3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:16.038172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 877/1780] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:16.073081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:16.074593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:16.399303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a819f1-d7a8-4685-882b-c66190709ecd admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:16.428120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:16.430589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:16.431272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:16.431894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:16.454202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:16.492251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:16.500212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf02e6d-dd05-4865-8c05-16d5e69c5298 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:16.528091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 904/1781] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:16.551937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b481d-f407-4b74-8641-f4387d5bd81b None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:16.552532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b481d-f407-4b74-8641-f4387d5bd81b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:16.552532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b481d-f407-4b74-8641-f4387d5bd81b None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:16.556422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 878/1782] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:50:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:50:16.633568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb985-faef-4421-b5e2-3e687bae2117 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:16.633915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb985-faef-4421-b5e2-3e687bae2117 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:16.634192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb985-faef-4421-b5e2-3e687bae2117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:16.660958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b481d-f407-4b74-8641-f4387d5bd81b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:16.664304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a00b481d-f407-4b74-8641-f4387d5bd81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:16.744676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ebebb985-faef-4421-b5e2-3e687bae2117 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:16.746020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ebebb985-faef-4421-b5e2-3e687bae2117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:16.784812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 905/1783] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:50:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:16.883857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b481d-f407-4b74-8641-f4387d5bd81b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:16.891098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:16.892640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:16.893309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:16.894026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] PATH_INFO: `/v3/projects/43b91664dc214164b5df82fc0c7465bd` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:16.896528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b91664dc214164b5df82fc0c7465bd)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:16.900047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:17.029137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b91664dc214164b5df82fc0c7465bd', 'request_id': 'req-821d67b7-6ec9-4271-a689-2d24788730fc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:17.040915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b91664dc214164b5df82fc0c7465bd', 'request_id': 'req-821d67b7-6ec9-4271-a689-2d24788730fc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:17.053638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b91664dc214164b5df82fc0c7465bd', 'request_id': 'req-821d67b7-6ec9-4271-a689-2d24788730fc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:17.078846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] The token cache is being invalidate because project 43b91664dc214164b5df82fc0c7465bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:17.079261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:17.080044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-821d67b7-6ec9-4271-a689-2d24788730fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:17.082046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 879/1784] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:16 2022] DELETE /identity/v3/projects/43b91664dc214164b5df82fc0c7465bd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:17.088502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.089024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.089265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.119452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:17.151975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:17.153722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:17.269953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 906/1785] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:17.279591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.279884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.280166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.315120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:17.316416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:17.330660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 880/1786] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:17.335658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:17.353305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef59ed-4e27-4d06-bcae-7554c26672ea None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:17.359229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:17.359830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.360117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.360395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.361273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:17.361657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:17.363444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:17.380727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 907/1787] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:50:17.385757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:17.399421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81817d-d592-44b0-bd73-8988c96b5c48 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:17.419309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:17.419938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.420254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.420490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.421150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:17.423295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:17.435379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:17.494144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 881/1788] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:17 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:17.499046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:17.513709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7269-0b4a-4204-83bb-38f9365ba9d0 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:17.722381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:17.723057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.723517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.723731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.724455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:17.734748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:17.814081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 908/1789] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:17 2022] POST /identity/v3/users => generated 282 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:17.817023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:17.832169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41075a-e8a7-4c35-9277-cc123822bf53 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:17.852948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:17.853690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.854019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.855820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.858231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:17.863169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:17.898246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 882/1790] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:17.903048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:17.924226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cfb4-5e83-416f-9d49-9371a10f9836 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:17.936277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a0cf-089e-46d2-b459-a968af2aeb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:17.942864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a0cf-089e-46d2-b459-a968af2aeb3c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:17.943181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a0cf-089e-46d2-b459-a968af2aeb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:17.944883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a0cf-089e-46d2-b459-a968af2aeb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:17.948798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467a0cf-089e-46d2-b459-a968af2aeb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:17.954115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467a0cf-089e-46d2-b459-a968af2aeb3c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:18.012105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 909/1791] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:18.015033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:18.035750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83171eca-563f-4e66-aafb-7b96a0d61373 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:18.058120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:18.059963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:18.061171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:18.061562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] PATH_INFO: `/v3/projects/97fa80a1540147568193ba4a2f28a321/users/8dff97b6f2964146ab768a7fcddd1fe5/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:18.108363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fa80a1540147568193ba4a2f28a321, user_id=8dff97b6f2964146ab768a7fcddd1fe5, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:18.111987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:18.139623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 883/1792] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:18 2022] PUT /identity/v3/projects/97fa80a1540147568193ba4a2f28a321/users/8dff97b6f2964146ab768a7fcddd1fe5/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:18.151670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:18.152709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:18.153202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:18.246910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] MFA Rules not processed for user `8dff97b6f2964146ab768a7fcddd1fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:18.248436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:18.424315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:18.437728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 910/1793] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:18.438208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:18.635636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841538-6168-4aab-af66-36fc778c7c40 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:18.647886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:18.648768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:18.649198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:18.649746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:18.650521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:18.655794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:18.718114 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 884/1794] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:18 2022] POST /identity/v3/projects => generated 365 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:18.722046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:18.739489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97aed-7b84-4234-b6da-90c7f3b332bd None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:18.884130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:18.885188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:18.885785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:18.885785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:18.886573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:18.889009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:18.927881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 911/1795] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:18 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:18.932575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:18.949095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422c71c-c6be-4e8b-ae29-1b2af21fba80 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:18.965520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:18.966722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:18.967102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:18.967481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:18.968241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:18.969977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:18.992728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 885/1796] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:18.994240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:19.007886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db46a0-30f7-4f95-87fb-dda58651adef admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:19.014379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:19.015089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.015370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.015646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] PATH_INFO: `/v3/projects/433d2dc2410c476d81960ac5a8d721e5/users/1fd3f1dc12544051ab5378fb8b41420f/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.050205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=433d2dc2410c476d81960ac5a8d721e5, user_id=1fd3f1dc12544051ab5378fb8b41420f, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:19.055826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:19.092547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 912/1797] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:18 2022] PUT /identity/v3/projects/433d2dc2410c476d81960ac5a8d721e5/users/1fd3f1dc12544051ab5378fb8b41420f/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:19.097463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:19.109119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef978f80-3490-4167-87dc-387c19e24477 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:19.183982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345d7f0-02cd-4d69-8da9-c4e9ed68128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:19.184868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d7f0-02cd-4d69-8da9-c4e9ed68128c admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.185292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d7f0-02cd-4d69-8da9-c4e9ed68128c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.185706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d7f0-02cd-4d69-8da9-c4e9ed68128c admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.186545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345d7f0-02cd-4d69-8da9-c4e9ed68128c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:19.188593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345d7f0-02cd-4d69-8da9-c4e9ed68128c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:19.201434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 886/1798] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:19.205800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:19.233145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222335b-5f30-4069-950f-26a027896b8f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:19.242513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:19.244526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.244982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.245292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] PATH_INFO: `/v3/projects/433d2dc2410c476d81960ac5a8d721e5/users/1fd3f1dc12544051ab5378fb8b41420f/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.248080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433d2dc2410c476d81960ac5a8d721e5, user_id=1fd3f1dc12544051ab5378fb8b41420f, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:19.252027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:19.267341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 913/1799] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:19 2022] PUT /identity/v3/projects/433d2dc2410c476d81960ac5a8d721e5/users/1fd3f1dc12544051ab5378fb8b41420f/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:19.281335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.281963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.282421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.298378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:19.300670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:19.339667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] MFA Rules not processed for user `1fd3f1dc12544051ab5378fb8b41420f`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:19.341187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:19.356575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:19.457906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 887/1800] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:19.458228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226776e0-a9df-4806-939a-fc2ed28bda12 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:19.466450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:19.468676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:19.475936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:19.477650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.477936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.478214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.483973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:19.543384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:19.544975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:19.558175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 914/1801] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:19.587173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aba20-54ff-4258-a746-ad610ca1ffab None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:19.591656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade884bd-295f-42b6-b0c8-ecac89c10887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:19.592430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade884bd-295f-42b6-b0c8-ecac89c10887 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.592821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade884bd-295f-42b6-b0c8-ecac89c10887 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.593516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade884bd-295f-42b6-b0c8-ecac89c10887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.606158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade884bd-295f-42b6-b0c8-ecac89c10887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:19.608040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade884bd-295f-42b6-b0c8-ecac89c10887 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:19.623171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 888/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:19.740410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:19.742833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:19.795939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:19.834374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11d41b-1bc6-4118-9a7b-10b79c2cfe11 service nova] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:19.842477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:19.844147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.845103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.845659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] PATH_INFO: `/v3/users/d59a58b12566424790ab3428e6e164cd` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:19.848305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59a58b12566424790ab3428e6e164cd)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:19.851824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:19.939985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59a58b12566424790ab3428e6e164cd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:19.954211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59a58b12566424790ab3428e6e164cd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:19.958245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59a58b12566424790ab3428e6e164cd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:19.978834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59a58b12566424790ab3428e6e164cd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:19.979720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59a58b12566424790ab3428e6e164cd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:19.989495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 915/1803] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:19 2022] DELETE /identity/v3/users/d59a58b12566424790ab3428e6e164cd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:19.991000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:19.992006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:19.992185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:20.013889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:20.015569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:20.143060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 889/1804] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:20.154824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:20.156349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:20.167508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:20.172294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:20.186647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313447f4-6beb-462f-ae02-23e7ba3bceed None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:20.192924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:20.193834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:20.193963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:20.194234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] PATH_INFO: `/v3/users/8dff97b6f2964146ab768a7fcddd1fe5` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:20.196361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dff97b6f2964146ab768a7fcddd1fe5)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:20.198196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:20.235683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbc9c2-8c55-4be8-9973-ac270b5db909 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:20.240014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4de597-c99f-4ab9-9451-edbbb6682b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:20.240636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4de597-c99f-4ab9-9451-edbbb6682b38 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:20.240947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4de597-c99f-4ab9-9451-edbbb6682b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:20.241230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4de597-c99f-4ab9-9451-edbbb6682b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:20.252935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4de597-c99f-4ab9-9451-edbbb6682b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:20.254638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4de597-c99f-4ab9-9451-edbbb6682b38 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:20.255989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dff97b6f2964146ab768a7fcddd1fe5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:20.257846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:20.266198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dff97b6f2964146ab768a7fcddd1fe5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:20.267239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 916/1805] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:20.281393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dff97b6f2964146ab768a7fcddd1fe5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:20.290001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dff97b6f2964146ab768a7fcddd1fe5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:20.290790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dff97b6f2964146ab768a7fcddd1fe5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:20.297603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 890/1806] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:20 2022] DELETE /identity/v3/users/8dff97b6f2964146ab768a7fcddd1fe5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:20.302155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:20.303468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:20.303891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:20.330879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:20.332229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:20.405711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:20.416426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 917/1807] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:20.428700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:20.431081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:20.523546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd118d00-de81-42f0-92da-a18c21a12ef5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:20.528330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:20.529417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:20.529909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:20.530201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:20.542504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:20.544727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:20.556779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 891/1808] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:21.056817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:21.062909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:21.090466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad3b4-9592-4e12-a7a7-9b25de195eb9 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:21.103818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:21.104476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:21.104759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:21.105035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] PATH_INFO: `/v3/projects/e0fec160d41744668f5e1adb8297b3de` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:21.106215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fec160d41744668f5e1adb8297b3de)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:21.108251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:21.169890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fec160d41744668f5e1adb8297b3de', 'request_id': 'req-068a0ea3-7a4b-4d1f-a348-50c067c1910c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.177183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fec160d41744668f5e1adb8297b3de', 'request_id': 'req-068a0ea3-7a4b-4d1f-a348-50c067c1910c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.188341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fec160d41744668f5e1adb8297b3de', 'request_id': 'req-068a0ea3-7a4b-4d1f-a348-50c067c1910c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.199896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] The token cache is being invalidate because project e0fec160d41744668f5e1adb8297b3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:21.200350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.201485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.203452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 918/1809] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:21 2022] DELETE /identity/v3/projects/e0fec160d41744668f5e1adb8297b3de => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:21.207282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:21.217430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbad2c-cc4f-4d5d-8367-cf90b2bbe4a8 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:21.245165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:21.247283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:21.317934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:21.318706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:21.319088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:21.319452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] PATH_INFO: `/v3/users/a015350f5e184d9e9768e52ab2a0fa95` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:21.320671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a015350f5e184d9e9768e52ab2a0fa95)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:21.322717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:21.323847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a0ea3-7a4b-4d1f-a348-50c067c1910c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:21.331094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:21.331835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:21.332187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:21.332583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] PATH_INFO: `/v3/projects/97fa80a1540147568193ba4a2f28a321` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:21.333976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fa80a1540147568193ba4a2f28a321)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:21.336340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:21.379434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a015350f5e184d9e9768e52ab2a0fa95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.387993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fa80a1540147568193ba4a2f28a321', 'request_id': 'req-a4c54c98-1f63-49fc-ab24-ae1d15235332'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.389534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a015350f5e184d9e9768e52ab2a0fa95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.396160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fa80a1540147568193ba4a2f28a321', 'request_id': 'req-a4c54c98-1f63-49fc-ab24-ae1d15235332'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.403508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:21.406690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fa80a1540147568193ba4a2f28a321', 'request_id': 'req-a4c54c98-1f63-49fc-ab24-ae1d15235332'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.406841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a015350f5e184d9e9768e52ab2a0fa95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.417272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a015350f5e184d9e9768e52ab2a0fa95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.418278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a015350f5e184d9e9768e52ab2a0fa95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.421610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] The token cache is being invalidate because project 97fa80a1540147568193ba4a2f28a321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:21.422243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.423101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.425003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 919/1810] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:21 2022] DELETE /identity/v3/projects/97fa80a1540147568193ba4a2f28a321 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:21.430673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 892/1811] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:21 2022] DELETE /identity/v3/users/a015350f5e184d9e9768e52ab2a0fa95 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:21.430842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:21.431444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:21.454907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:21.504930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c54c98-1f63-49fc-ab24-ae1d15235332 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:21.561866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:21.562500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:21.562813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:21.563085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] PATH_INFO: `/v3/users/1fd3f1dc12544051ab5378fb8b41420f` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:21.564210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd3f1dc12544051ab5378fb8b41420f)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:21.566118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:21.617467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd3f1dc12544051ab5378fb8b41420f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.624270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd3f1dc12544051ab5378fb8b41420f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.631853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd3f1dc12544051ab5378fb8b41420f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.643906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd3f1dc12544051ab5378fb8b41420f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.644580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6f80d6a5-9bc5-4148-9231-3769e597e849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd3f1dc12544051ab5378fb8b41420f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.651439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 920/1812] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:21 2022] DELETE /identity/v3/users/1fd3f1dc12544051ab5378fb8b41420f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:21.721393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:21.723471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:21.740439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b98000-c4b4-41b9-b8a8-e4e526bf1b31 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:21.810350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:21.811056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:21.811321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:21.811602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] PATH_INFO: `/v3/projects/3be5a6dca53d48059852d9488beb62c7` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:21.813077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be5a6dca53d48059852d9488beb62c7)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:21.815653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:21.876895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be5a6dca53d48059852d9488beb62c7', 'request_id': 'req-7c2468bc-6d08-491c-a79c-a6246d16da88'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.884136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be5a6dca53d48059852d9488beb62c7', 'request_id': 'req-7c2468bc-6d08-491c-a79c-a6246d16da88'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.899009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be5a6dca53d48059852d9488beb62c7', 'request_id': 'req-7c2468bc-6d08-491c-a79c-a6246d16da88'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.915117 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] The token cache is being invalidate because project 3be5a6dca53d48059852d9488beb62c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:21.915820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.918132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7c2468bc-6d08-491c-a79c-a6246d16da88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:21.921116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 893/1813] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:21 2022] DELETE /identity/v3/projects/3be5a6dca53d48059852d9488beb62c7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:21.927172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:21.927936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:21.929642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:21.956839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:21.958890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.011401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:22.074515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 921/1814] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:22.076527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.077031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.077276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.088878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.091829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.111335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd5e51-b763-447e-83d0-c11523f512c8 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.117864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:22.118840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.119169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.120031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.120518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.121259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] PATH_INFO: `/v3/projects/433d2dc2410c476d81960ac5a8d721e5` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.122819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=433d2dc2410c476d81960ac5a8d721e5)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.125444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.137594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 894/1815] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:22.143900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.169641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cced86-ddff-480c-b031-ea28f34ad8b7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.174971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.175917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.176199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.176479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.177140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:22.177449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.179277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.193330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 895/1816] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:22.198031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.209300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563b79-869f-4430-b6e8-ddce269717b2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.222364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433d2dc2410c476d81960ac5a8d721e5', 'request_id': 'req-979db7fa-b783-4c91-82e4-aca0a8b78e6a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:22.229418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433d2dc2410c476d81960ac5a8d721e5', 'request_id': 'req-979db7fa-b783-4c91-82e4-aca0a8b78e6a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:22.237902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433d2dc2410c476d81960ac5a8d721e5', 'request_id': 'req-979db7fa-b783-4c91-82e4-aca0a8b78e6a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:22.250258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] The token cache is being invalidate because project 433d2dc2410c476d81960ac5a8d721e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:22.250258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:22.251393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-979db7fa-b783-4c91-82e4-aca0a8b78e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:22.253512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 922/1817] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:22 2022] DELETE /identity/v3/projects/433d2dc2410c476d81960ac5a8d721e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:22.258551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd79ee-5435-4cba-b51e-8775caffffcf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.258865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd79ee-5435-4cba-b51e-8775caffffcf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.259146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd79ee-5435-4cba-b51e-8775caffffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.283271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2cfd79ee-5435-4cba-b51e-8775caffffcf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:22.283840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:22.285087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2cfd79ee-5435-4cba-b51e-8775caffffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.291076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.291830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.292115 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.292393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.293025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.295092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.296301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 923/1818] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:22.304280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.304751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.306034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.333230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 896/1819] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:22.337455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.338974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:22.339206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.340164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.417974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 924/1820] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:22.421825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.423410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ebdb-0e4d-4087-b7e9-34e74d712120 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.428273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.429411 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.429677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.429948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.430862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.432482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054d5f5-b0ee-4179-adab-83a0209f2622 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.432795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.437226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.437833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.438233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.438523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.439230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:22.439538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.441332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.456272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 925/1821] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:50:22.460216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.462009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 897/1822] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:22.463183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.475978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814f24d-a0ae-4354-beb4-8089751bd358 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.477572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc261-a65c-40c6-b0f2-5f5c250e1e3d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.486232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.486470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.487129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.487387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.487497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.487659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.487764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.487937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.488279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.488586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.490170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.490290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.501379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 898/1823] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:22.505611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.516258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0c4d6-330f-41ac-8724-234ae9142757 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.521198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.521979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.522281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.522529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.523207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.523875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 926/1824] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:22.524879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.527990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.537271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 899/1825] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:22.541352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.551561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e63c11-72c7-4e98-ab40-276c6e01f789 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.559841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:22.606545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac67d4-503f-40d1-ab4f-d0b0e22183a6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.611957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.612714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.613081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.613460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.614225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.616886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.621007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731651d-abd9-47fe-aa1c-25edb3bcec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.621806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731651d-abd9-47fe-aa1c-25edb3bcec8a admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.622090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731651d-abd9-47fe-aa1c-25edb3bcec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.622367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731651d-abd9-47fe-aa1c-25edb3bcec8a admin admin] PATH_INFO: `/v3/projects/f51582815e5f48cf9a62353c398e0aa8/users/4e2fed5e1e054f47ba9d59eaf4076267/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.639726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 927/1826] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:22.639899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731651d-abd9-47fe-aa1c-25edb3bcec8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51582815e5f48cf9a62353c398e0aa8, user_id=4e2fed5e1e054f47ba9d59eaf4076267, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.643029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731651d-abd9-47fe-aa1c-25edb3bcec8a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.643573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.654538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0755c-db6d-485d-abbd-e68472455bfb admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.657431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 900/1827] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:22 2022] PUT /identity/v3/projects/f51582815e5f48cf9a62353c398e0aa8/users/4e2fed5e1e054f47ba9d59eaf4076267/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:22.668174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.668456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.668725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.695850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] MFA Rules not processed for user `4e2fed5e1e054f47ba9d59eaf4076267`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:22.697183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.712794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.713405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.713687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.713976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.714631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.716368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.717667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:22.727166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 928/1828] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:22.731082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.740435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d68c1-9853-49a9-97a4-ebd2ec0b05cc admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.745583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.746174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.746457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.746769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.747388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.748975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.762753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 929/1829] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:22.763717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.764016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 901/1830] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:22.768211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.773596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b37d33-f048-42c9-b086-e457c75b4bef admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.778430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba9e6-b004-4fcd-b25f-cbda62cd843f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.778882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.779524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.779867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.780082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] PATH_INFO: `/v3/projects/32bf3006c8f84d95ba777a9ceb0916ae/users/616a376ed4324f04b839dde7cf62839d/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.783128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56c8d-490b-44ca-8c1e-d07b73512968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.783764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56c8d-490b-44ca-8c1e-d07b73512968 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.784006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56c8d-490b-44ca-8c1e-d07b73512968 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.784278 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56c8d-490b-44ca-8c1e-d07b73512968 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.784944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c56c8d-490b-44ca-8c1e-d07b73512968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.787015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c56c8d-490b-44ca-8c1e-d07b73512968 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.794808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bf3006c8f84d95ba777a9ceb0916ae, user_id=616a376ed4324f04b839dde7cf62839d, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.797457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.811438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 930/1831] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:22 2022] PUT /identity/v3/projects/32bf3006c8f84d95ba777a9ceb0916ae/users/616a376ed4324f04b839dde7cf62839d/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:22.820536 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 902/1832] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:22.821221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.821647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.821937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.822212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.849856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] MFA Rules not processed for user `616a376ed4324f04b839dde7cf62839d`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:22.851635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:22.888801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad99ce-b906-4ee5-8df9-f260055c90b9 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.906887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:22.926727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 903/1833] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:22.931929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.949746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.950359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.950674 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.950956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.951579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.953531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.975834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 931/1834] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:22.979987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:22.989418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a01867-ed3c-4256-85df-ea7f292a58fc admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.993583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81001c6e-2784-4e66-a306-2f7d25cc22ff None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:22.994760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.995344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.995625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.995900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:22.996593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:22.998216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:22.998328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:22.998831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:22.999113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:22.999383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.000001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.001906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.010510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 932/1835] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:23.014744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.025900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e792e-047a-4a59-9f98-b63f205bccf2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.032449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 904/1836] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:22 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:23.032604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.032604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.032604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.032604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] PATH_INFO: `/v3/projects/ee5db9fb5a594224859c1fe245152276/users/47b429baa608475eb81903cf548d3afe/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.033744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.048382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5db9fb5a594224859c1fe245152276, user_id=47b429baa608475eb81903cf548d3afe, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.051080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.051397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:23.067890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 933/1837] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:23 2022] PUT /identity/v3/projects/ee5db9fb5a594224859c1fe245152276/users/47b429baa608475eb81903cf548d3afe/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:23.071697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.114573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07106ae0-eabe-47b2-a132-4a69a2b729a2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.143711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749722c3-5bfa-46d3-96df-e0c1d47e8746 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.150295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.151056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.151405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.151750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.152474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.154374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.169120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 934/1838] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:23.169973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.181062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e0187-bc02-4686-a75c-cefdef8f2d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.181760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf8aa4-b133-4ec1-b5a2-a83b6fff4853 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.182040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e0187-bc02-4686-a75c-cefdef8f2d6d admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.182448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e0187-bc02-4686-a75c-cefdef8f2d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.182752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e0187-bc02-4686-a75c-cefdef8f2d6d admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.183378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e0187-bc02-4686-a75c-cefdef8f2d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.185331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e0187-bc02-4686-a75c-cefdef8f2d6d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.187484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.188162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.188933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.188933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] PATH_INFO: `/v3/projects/ee5db9fb5a594224859c1fe245152276/users/47b429baa608475eb81903cf548d3afe/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.190837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5db9fb5a594224859c1fe245152276, user_id=47b429baa608475eb81903cf548d3afe, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.193518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.206716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 935/1839] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:23 2022] PUT /identity/v3/projects/ee5db9fb5a594224859c1fe245152276/users/47b429baa608475eb81903cf548d3afe/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:23.210320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 905/1840] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:23 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:23.214264 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.222244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.222244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.222244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.254754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] MFA Rules not processed for user `47b429baa608475eb81903cf548d3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:23.255970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:23.289137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:23.293776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd26e2-142b-484b-8ba0-2ba4045bd6a1 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.300820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.301599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.302033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.302281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.303865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.305266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.318299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 936/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:23.322794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.334854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee84e71-2b0f-4c98-9d3b-d8a31379b919 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.339911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.340600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.340996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.341676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] PATH_INFO: `/v3/projects/85346868b1954c7b9d088ebfe0cac93f/users/1da8cdef2d3b426ba06798a9a01decf0/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.346265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 906/1842] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:23.347319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.348762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:23.358624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85346868b1954c7b9d088ebfe0cac93f, user_id=1da8cdef2d3b426ba06798a9a01decf0, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.361719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.379528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 937/1843] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:23 2022] PUT /identity/v3/projects/85346868b1954c7b9d088ebfe0cac93f/users/1da8cdef2d3b426ba06798a9a01decf0/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:23.384374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.400102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:23.430932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a19ce-b161-405b-b7cf-9bc350ecad56 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.456818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a951fc-e847-43aa-a608-28e50199cc29 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.461765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.462470 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.462788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.463139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.463790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.465520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.479050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 938/1844] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:23.481720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.492771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.493394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.493678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.493955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.497963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838629ce-86a1-4596-9751-c13001c62e36 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.505072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83854dc4-bd3e-4b95-8f62-9e07db2ec4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.505765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854dc4-bd3e-4b95-8f62-9e07db2ec4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.506041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854dc4-bd3e-4b95-8f62-9e07db2ec4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.506557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83854dc4-bd3e-4b95-8f62-9e07db2ec4f1 admin admin] PATH_INFO: `/v3/projects/85346868b1954c7b9d088ebfe0cac93f/users/1da8cdef2d3b426ba06798a9a01decf0/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.509113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83854dc4-bd3e-4b95-8f62-9e07db2ec4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85346868b1954c7b9d088ebfe0cac93f, user_id=1da8cdef2d3b426ba06798a9a01decf0, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.511811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83854dc4-bd3e-4b95-8f62-9e07db2ec4f1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.523238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 939/1845] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:23 2022] PUT /identity/v3/projects/85346868b1954c7b9d088ebfe0cac93f/users/1da8cdef2d3b426ba06798a9a01decf0/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:23.534834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.535023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.535285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.558444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.559940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.569077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] MFA Rules not processed for user `1da8cdef2d3b426ba06798a9a01decf0`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:23.569815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 907/1846] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:23.570378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:23.654483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 940/1847] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:23.668082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.670259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:23.695042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e6344-2039-47e6-8f8d-c8dd00e07824 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.765580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.766244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.766748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.766970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.778414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.779982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:23.791017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 908/1848] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:23.906011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:23.917168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c55764-3db0-4543-8a84-cfb476eb61cd None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:23.926911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d21a82-95da-4cdb-8aa0-ef76198c2e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:23.927711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d21a82-95da-4cdb-8aa0-ef76198c2e6d service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:23.928156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d21a82-95da-4cdb-8aa0-ef76198c2e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:23.928615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d21a82-95da-4cdb-8aa0-ef76198c2e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:23.969121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:23.994096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d21a82-95da-4cdb-8aa0-ef76198c2e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:23.995582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d21a82-95da-4cdb-8aa0-ef76198c2e6d service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:24.004289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 941/1849] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:24.274247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:24.336669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:24.349031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21e3-e89e-4dc7-be13-7d977b5eb46b service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:24.353618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:24.354255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:24.354537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:24.354922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] PATH_INFO: `/v3/users/616a376ed4324f04b839dde7cf62839d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:24.356060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616a376ed4324f04b839dde7cf62839d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:24.357976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:24.406222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616a376ed4324f04b839dde7cf62839d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:24.417393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616a376ed4324f04b839dde7cf62839d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:24.429697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616a376ed4324f04b839dde7cf62839d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:24.437315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616a376ed4324f04b839dde7cf62839d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:24.438003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616a376ed4324f04b839dde7cf62839d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:24.444513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 909/1850] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:24 2022] DELETE /identity/v3/users/616a376ed4324f04b839dde7cf62839d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:24.449145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:24.449637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:24.449744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:24.468842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:24.470054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:24.528879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 942/1851] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:24.538574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:24.540188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:24.598407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9843-95c0-45ed-88fc-58583dd0e169 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:24.602156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:24.602800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:24.603084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:24.603361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:24.613329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:24.614789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:24.624907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 910/1852] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:25.143146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:25.144703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:25.157496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f1fd5-c4a3-4b9c-bcda-05e67a5e686f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:25.165043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:25.165244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:25.165588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:25.166429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] PATH_INFO: `/v3/projects/32bf3006c8f84d95ba777a9ceb0916ae` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:25.168473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bf3006c8f84d95ba777a9ceb0916ae)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:25.171089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:25.240875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bf3006c8f84d95ba777a9ceb0916ae', 'request_id': 'req-7ec4f046-f8ab-44ea-b947-d4a214627111'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.247059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bf3006c8f84d95ba777a9ceb0916ae', 'request_id': 'req-7ec4f046-f8ab-44ea-b947-d4a214627111'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.256326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bf3006c8f84d95ba777a9ceb0916ae', 'request_id': 'req-7ec4f046-f8ab-44ea-b947-d4a214627111'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.273734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] The token cache is being invalidate because project 32bf3006c8f84d95ba777a9ceb0916ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:25.275081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.275868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.281637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 943/1853] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:25 2022] DELETE /identity/v3/projects/32bf3006c8f84d95ba777a9ceb0916ae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:25.283194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:25.293221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f57412-644e-4bae-912f-0234a13b991d service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:25.358209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:25.358209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:25.358209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:25.360598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] PATH_INFO: `/v3/users/1da8cdef2d3b426ba06798a9a01decf0` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:25.360598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da8cdef2d3b426ba06798a9a01decf0)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:25.362369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:25.378746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:25.413605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da8cdef2d3b426ba06798a9a01decf0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.421594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da8cdef2d3b426ba06798a9a01decf0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.438978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da8cdef2d3b426ba06798a9a01decf0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.447607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da8cdef2d3b426ba06798a9a01decf0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.448344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aac16695-c8e6-4db6-a1ad-a6c3b49991ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da8cdef2d3b426ba06798a9a01decf0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.454773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 911/1854] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:25 2022] DELETE /identity/v3/users/1da8cdef2d3b426ba06798a9a01decf0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:25.775085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:25.776973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:25.792810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4f046-f8ab-44ea-b947-d4a214627111 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:25.854676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:25.855709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:25.855989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:25.856265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] PATH_INFO: `/v3/projects/85346868b1954c7b9d088ebfe0cac93f` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:25.857473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85346868b1954c7b9d088ebfe0cac93f)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:25.859436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:25.861646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:25.912355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85346868b1954c7b9d088ebfe0cac93f', 'request_id': 'req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.919430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85346868b1954c7b9d088ebfe0cac93f', 'request_id': 'req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.927752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85346868b1954c7b9d088ebfe0cac93f', 'request_id': 'req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.939385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] The token cache is being invalidate because project 85346868b1954c7b9d088ebfe0cac93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:25.939885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.940694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c8442e8f-e0a0-4bcf-be1e-d7c1c4e7d47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:25.942199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 944/1855] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:25 2022] DELETE /identity/v3/projects/85346868b1954c7b9d088ebfe0cac93f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:25.947040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:25.947338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:25.947618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:25.966960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:25.968175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:26.062688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 912/1856] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:26.069497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.070454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.070834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.097896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:26.098484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:26.108594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 945/1857] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:26.113123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.128656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a7466-5608-4487-9f9b-de74b2419cec None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.133626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.134355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.134800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.135175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.136164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:26.136654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.138439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.152519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 913/1858] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:26.156521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.168091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ccda-b5e5-4036-8cdc-bd6afe83a535 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.176224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.176954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.177238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.177507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.178132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.180244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.234144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 946/1859] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:26 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:26.235363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.247129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b0fb4-9073-4471-b58d-bd977c881766 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.332785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.332785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.332785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.332785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.333570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.333570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.367045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 914/1860] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:26 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:26.368039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.381228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26604e5a-9dd2-454f-aa9d-2527cd4a3ed2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.401474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.402183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.402523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.402886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.403628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.405354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.420434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 947/1861] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:26.421760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.439098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1d1a-cc20-4a41-859d-e3bf22d5e4ff admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.445786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572678-67dc-4208-a14e-10814674778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.446490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572678-67dc-4208-a14e-10814674778a admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.447948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572678-67dc-4208-a14e-10814674778a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.448325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572678-67dc-4208-a14e-10814674778a admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.449145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572678-67dc-4208-a14e-10814674778a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.451291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572678-67dc-4208-a14e-10814674778a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.454877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:26.475817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.483442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 915/1862] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:26.488645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd3cfd-93c4-461f-a899-566ff831ed29 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.495561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.496331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.497290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.497678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] PATH_INFO: `/v3/projects/730811999bbb4ba39e2f00659c8eb291/users/1616470cf4584199a5295b201d4fa82d/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.524500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=730811999bbb4ba39e2f00659c8eb291, user_id=1616470cf4584199a5295b201d4fa82d, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.528263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.556361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 948/1863] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:26 2022] PUT /identity/v3/projects/730811999bbb4ba39e2f00659c8eb291/users/1616470cf4584199a5295b201d4fa82d/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:26.558328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.558870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.559412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.595013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] MFA Rules not processed for user `1616470cf4584199a5295b201d4fa82d`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:26.596358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:26.673734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 916/1864] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:26.686590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.688689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:26.752365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e4d6d-2bb0-40d8-a072-108e1c2eb430 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.756269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b448-42d2-48fc-b5ed-630fd386c965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.757384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b448-42d2-48fc-b5ed-630fd386c965 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.757718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b448-42d2-48fc-b5ed-630fd386c965 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.757952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b448-42d2-48fc-b5ed-630fd386c965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.767650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58b448-42d2-48fc-b5ed-630fd386c965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.769078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58b448-42d2-48fc-b5ed-630fd386c965 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.780584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 949/1865] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:26.801630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:26.868682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dacc7-5629-4eb9-8079-aa63d8966a83 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:26.873291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:26.873921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.874315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.874592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] PATH_INFO: `/v3/users/1616470cf4584199a5295b201d4fa82d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.875750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1616470cf4584199a5295b201d4fa82d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:26.877640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:26.923227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1616470cf4584199a5295b201d4fa82d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:26.931121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1616470cf4584199a5295b201d4fa82d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:26.942472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1616470cf4584199a5295b201d4fa82d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:26.949737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1616470cf4584199a5295b201d4fa82d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:26.950372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1616470cf4584199a5295b201d4fa82d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:26.956080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 917/1866] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:26 2022] DELETE /identity/v3/users/1616470cf4584199a5295b201d4fa82d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:26.960618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:26.960921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:26.961194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:26.979662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:26.980831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:27.003830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:27.039713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 950/1867] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:27.049379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.050630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:27.061468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:27.114213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3954-ac86-4af3-a503-936c2b1f9913 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.118449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704fa08-16a1-4064-a334-74dda5fc9fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.119097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704fa08-16a1-4064-a334-74dda5fc9fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.119382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704fa08-16a1-4064-a334-74dda5fc9fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.119685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704fa08-16a1-4064-a334-74dda5fc9fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.128580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704fa08-16a1-4064-a334-74dda5fc9fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.129995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704fa08-16a1-4064-a334-74dda5fc9fc8 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.140182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 918/1868] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:27.435970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.437751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:27.451704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d3d3-340a-4d1c-be0a-fcc608ca6fa2 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.456536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.457182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.457547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.457831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] PATH_INFO: `/v3/projects/730811999bbb4ba39e2f00659c8eb291` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.459283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=730811999bbb4ba39e2f00659c8eb291)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.461459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.510367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730811999bbb4ba39e2f00659c8eb291', 'request_id': 'req-465d8933-a2ab-46d5-8653-d73c635d7ce4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:27.516957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730811999bbb4ba39e2f00659c8eb291', 'request_id': 'req-465d8933-a2ab-46d5-8653-d73c635d7ce4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:27.525171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730811999bbb4ba39e2f00659c8eb291', 'request_id': 'req-465d8933-a2ab-46d5-8653-d73c635d7ce4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:27.535918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] The token cache is being invalidate because project 730811999bbb4ba39e2f00659c8eb291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:27.536240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:27.536888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-465d8933-a2ab-46d5-8653-d73c635d7ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:27.539111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 951/1869] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:27 2022] DELETE /identity/v3/projects/730811999bbb4ba39e2f00659c8eb291 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:27.543918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.544374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.544599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.564483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:27.565782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:27.640156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 919/1870] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:27.649468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.649759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.650039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.670056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:27.671290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:27.679368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 952/1871] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:27.683784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.695569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d890e-d4a9-4a12-921e-1e6b492aa698 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.700781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.701502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.701782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.702055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.702740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:27.703048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.704839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.718548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 920/1872] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:27.722799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.732626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e3e1a-bfbb-493c-af0d-f9b99005c96a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.737231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.737926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.738269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.738652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.739273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.741179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.769026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 953/1873] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:27 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:27.773610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.783552 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf30b8-c75d-4b86-957a-4fbe2fa6ce4a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.841050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.841707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.841973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.842249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.842914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.844808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.866009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 921/1874] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:27 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:27.870246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.881213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdee5e-278c-4e93-ab69-70dcb9c62178 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.886766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.887375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.887653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.887927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.888568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.890137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.901173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 954/1875] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:27.905287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.915224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9546-b8d2-4b8a-bc09-629cd6960028 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.919809 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059602-4e67-40da-b760-8ded4b0b01a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.920409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059602-4e67-40da-b760-8ded4b0b01a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.920750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059602-4e67-40da-b760-8ded4b0b01a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.921057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059602-4e67-40da-b760-8ded4b0b01a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.921783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0059602-4e67-40da-b760-8ded4b0b01a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.923444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0059602-4e67-40da-b760-8ded4b0b01a7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.934668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 922/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:27.939021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:27.949641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f26a3-6f5b-4a17-a1fc-109f55b30d3b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:27.954218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:27.954901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.955186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.955468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] PATH_INFO: `/v3/projects/058d565f1e2a48e8b25fa60e65b9258e/users/b324cdabadbd43dba313e8dff3a846b4/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:27.970441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] RBAC: Authorizing `identity:create_grant(project_id=058d565f1e2a48e8b25fa60e65b9258e, user_id=b324cdabadbd43dba313e8dff3a846b4, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:27.973145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:27.986538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 955/1877] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:27 2022] PUT /identity/v3/projects/058d565f1e2a48e8b25fa60e65b9258e/users/b324cdabadbd43dba313e8dff3a846b4/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:27.996773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:27.997058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:27.997359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:28.028184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] MFA Rules not processed for user `b324cdabadbd43dba313e8dff3a846b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:28.029432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:28.033490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:28.098538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 923/1878] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:28.109532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:28.111241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:28.164725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:28.168731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d9db-b199-411d-bd70-d5c8f4af323c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:28.173461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe06e5-1c5e-46e9-a31c-f4afc22f1229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:28.174307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe06e5-1c5e-46e9-a31c-f4afc22f1229 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:28.174796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe06e5-1c5e-46e9-a31c-f4afc22f1229 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:28.175239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe06e5-1c5e-46e9-a31c-f4afc22f1229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:28.183753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe06e5-1c5e-46e9-a31c-f4afc22f1229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:28.185189 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe06e5-1c5e-46e9-a31c-f4afc22f1229 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:28.194387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 956/1879] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:28.215862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:28.279457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd0a7e-0949-4b3f-a6c1-1f44ecaa9427 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:28.284069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:28.284705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:28.284989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:28.285268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] PATH_INFO: `/v3/users/b324cdabadbd43dba313e8dff3a846b4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:28.286398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b324cdabadbd43dba313e8dff3a846b4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:28.288354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:28.334629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b324cdabadbd43dba313e8dff3a846b4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.342405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b324cdabadbd43dba313e8dff3a846b4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.355904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b324cdabadbd43dba313e8dff3a846b4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.363635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b324cdabadbd43dba313e8dff3a846b4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.364259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b324cdabadbd43dba313e8dff3a846b4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.371716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 924/1880] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:28 2022] DELETE /identity/v3/users/b324cdabadbd43dba313e8dff3a846b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:28.380717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:28.381008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:28.381979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:28.405266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:28.406399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:28.474484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 957/1881] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:28.484140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:28.485563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:28.515294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:28.546229 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a225-8787-41c9-9a6b-820c28eb7b5b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:28.549983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5a2e5-c3cc-46bb-8b5c-9910f19188e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:28.550690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a2e5-c3cc-46bb-8b5c-9910f19188e7 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:28.551043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a2e5-c3cc-46bb-8b5c-9910f19188e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:28.551426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a2e5-c3cc-46bb-8b5c-9910f19188e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:28.561390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5a2e5-c3cc-46bb-8b5c-9910f19188e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:28.562825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5a2e5-c3cc-46bb-8b5c-9910f19188e7 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:28.572645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 925/1882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:28.879072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:28.881696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:28.900807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7b77-b165-47bf-95b7-6b134ddf4daf None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:28.912363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:28.913725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:28.914008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:28.914401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] PATH_INFO: `/v3/projects/058d565f1e2a48e8b25fa60e65b9258e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:28.915809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=058d565f1e2a48e8b25fa60e65b9258e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:28.917748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:28.976368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058d565f1e2a48e8b25fa60e65b9258e', 'request_id': 'req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.983815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058d565f1e2a48e8b25fa60e65b9258e', 'request_id': 'req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:28.994014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058d565f1e2a48e8b25fa60e65b9258e', 'request_id': 'req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:29.007795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] The token cache is being invalidate because project 058d565f1e2a48e8b25fa60e65b9258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:29.008194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:29.008922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c015f64e-c1f1-4e8b-868b-b7cd31ed5a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:29.013842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 958/1883] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:28 2022] DELETE /identity/v3/projects/058d565f1e2a48e8b25fa60e65b9258e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:29.015713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.015852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.016083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.042917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:29.042917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:29.103022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 926/1884] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:29.110735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.111025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.111309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.132005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:29.133198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:29.141097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 959/1885] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:29.145426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.155967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a668-fa7b-464d-9631-2c68c9c3b3e8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.160660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.161370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.161658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.161935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.163186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:29.163493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.165089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.178755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 927/1886] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:29.181730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.191061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3e604-818d-47c6-9c54-6c80786c2505 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.196118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.196714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.196995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.197265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.197910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.199864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.232201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 960/1887] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:29.236259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.246170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70d6e4-b9fb-4936-bc36-93edf80610f4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.307293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.307902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.308181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.308453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.309088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.311225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.336975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 928/1888] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:29.338227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.348421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef5d52-369e-4f7a-84ec-e7785b1d0fdf admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.353640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.354237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.354518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.354862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.355505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.357198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.367831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 961/1889] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:29.371748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.382692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168023c-9abf-4b37-bcaf-d6457fa6886f admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.387488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f3da4-5c47-472f-8f72-01da8f829bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.388096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f3da4-5c47-472f-8f72-01da8f829bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.388413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f3da4-5c47-472f-8f72-01da8f829bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.388695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f3da4-5c47-472f-8f72-01da8f829bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.389341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f3da4-5c47-472f-8f72-01da8f829bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.391054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f3da4-5c47-472f-8f72-01da8f829bd9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.403100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 929/1890] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:29.407151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.418265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde9f59-0e42-4a5f-881b-0e4ea3541e7e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.423934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.424592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.424872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.425150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] PATH_INFO: `/v3/projects/fc5686505633436fabee4705cd0d2bd0/users/f1c39aba9a904b309b5850fb1c25493e/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.443530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5686505633436fabee4705cd0d2bd0, user_id=f1c39aba9a904b309b5850fb1c25493e, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.447233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.477706 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.478007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.478272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.480928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 962/1891] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:29 2022] PUT /identity/v3/projects/fc5686505633436fabee4705cd0d2bd0/users/f1c39aba9a904b309b5850fb1c25493e/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:29.488384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.490662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:29.510822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] MFA Rules not processed for user `f1c39aba9a904b309b5850fb1c25493e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:29.512053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:29.514811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:29.544094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:29.591776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbea91-be54-4575-806e-43c3ee62588b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.597741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.598425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.598911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.599313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.607604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 930/1892] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:29.615143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.616384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:29.691193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb64f97-adbe-479f-a463-05e5c4308336 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.692301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.694344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.696454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.697070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.697352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.697630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.698412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.700335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.704872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 963/1893] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:29.733673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 931/1894] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:29.737792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.760129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd33e-f127-4ded-9492-672bc0649815 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.890973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.892349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.892770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.893286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.894404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.897149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.928817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 964/1895] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:29 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:29.933305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:29.950416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcf9b7-895e-45a1-ab3f-90836e3ddc43 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:29.956347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:29.956976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:29.957264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:29.957597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:29.958259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:29.960058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:29.975985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 932/1896] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:29.986307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.002237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0e386-c287-4c88-ade3-1582738c2e8e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.009455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75917f2f-2b28-4f15-ad17-06892e07e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.010793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75917f2f-2b28-4f15-ad17-06892e07e8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.011178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75917f2f-2b28-4f15-ad17-06892e07e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.011739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75917f2f-2b28-4f15-ad17-06892e07e8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.012550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75917f2f-2b28-4f15-ad17-06892e07e8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.015134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75917f2f-2b28-4f15-ad17-06892e07e8a1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.031147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 965/1897] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:30.035388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.049286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f899-14bf-4210-b429-52e81532e4fc admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.075327 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.078347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.079353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.080599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] PATH_INFO: `/v3/projects/23ab7d2606c14e53ab14ccdba86fd8a5/users/55990fa80202461f84d6bb7950201bf3/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.118171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ab7d2606c14e53ab14ccdba86fd8a5, user_id=55990fa80202461f84d6bb7950201bf3, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.123343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.157088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 933/1898] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:30 2022] PUT /identity/v3/projects/23ab7d2606c14e53ab14ccdba86fd8a5/users/55990fa80202461f84d6bb7950201bf3/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:30.169249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.169599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.170074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.211133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] MFA Rules not processed for user `55990fa80202461f84d6bb7950201bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:30.213370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:30.266055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:30.319662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 966/1899] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:30.324511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.401492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e704106-286a-458d-9cf5-caf71906c4e8 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.406462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.407013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.407299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.407572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.409291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.410107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.433924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:30.444613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 934/1900] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:30 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:30.449347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.465637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd64b0-b652-4a8c-939f-27a09498742a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.532589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.533125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.533420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.533689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.534308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.536250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.558815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 967/1901] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:30 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:30.562823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.572962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb60cf-69d5-45b9-838e-7a29fa8b0f6f admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.577460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.578052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.578334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.578639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.579270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.580862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.591507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 935/1902] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:30.595565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.605900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862d6d-712c-4709-b512-cd80b4575e60 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.610488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.611164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.611460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.611712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] PATH_INFO: `/v3/projects/4a60cefe6dd348dfb49ca77471e46f62/users/0f7ee2b4889f42769f3e48fe94c390d9/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.627684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a60cefe6dd348dfb49ca77471e46f62, user_id=0f7ee2b4889f42769f3e48fe94c390d9, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.630332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.643682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 968/1903] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:30 2022] PUT /identity/v3/projects/4a60cefe6dd348dfb49ca77471e46f62/users/0f7ee2b4889f42769f3e48fe94c390d9/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:30.648177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.658289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e530da-b4ad-4ea3-8813-71d7e7cc04d7 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.715059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de83de-2652-405b-8a3a-60a9bbbc61bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.715676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de83de-2652-405b-8a3a-60a9bbbc61bb admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.715961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de83de-2652-405b-8a3a-60a9bbbc61bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.716237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de83de-2652-405b-8a3a-60a9bbbc61bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.716960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de83de-2652-405b-8a3a-60a9bbbc61bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.718554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de83de-2652-405b-8a3a-60a9bbbc61bb admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.729048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 936/1904] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:30.733603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.743724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae7c55-63a6-438b-a676-8a23f0312c39 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.749836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.751206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.751643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.752071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] PATH_INFO: `/v3/projects/4a60cefe6dd348dfb49ca77471e46f62/users/0f7ee2b4889f42769f3e48fe94c390d9/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.755302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a60cefe6dd348dfb49ca77471e46f62, user_id=0f7ee2b4889f42769f3e48fe94c390d9, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:30.758165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:30.769339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 969/1905] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:30 2022] PUT /identity/v3/projects/4a60cefe6dd348dfb49ca77471e46f62/users/0f7ee2b4889f42769f3e48fe94c390d9/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:30.781234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5570b4-83e0-4da5-b31f-98c0282a7edf None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.781526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5570b4-83e0-4da5-b31f-98c0282a7edf None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.781806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5570b4-83e0-4da5-b31f-98c0282a7edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.809992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2e5570b4-83e0-4da5-b31f-98c0282a7edf None None] MFA Rules not processed for user `0f7ee2b4889f42769f3e48fe94c390d9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:30.811328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2e5570b4-83e0-4da5-b31f-98c0282a7edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:30.882190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 937/1906] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:30.894548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:30.896293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:30.954983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db273da4-0cc6-46b8-bdc7-83c5c815c086 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:30.958785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1490d-4b71-4633-b21b-bbd26f33de58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:30.960046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1490d-4b71-4633-b21b-bbd26f33de58 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:30.960336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1490d-4b71-4633-b21b-bbd26f33de58 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:30.960612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1490d-4b71-4633-b21b-bbd26f33de58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:30.993845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:31.017424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1490d-4b71-4633-b21b-bbd26f33de58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:31.018898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1490d-4b71-4633-b21b-bbd26f33de58 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:31.028115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 970/1907] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:33.602302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ca6d3-985e-49db-962b-a444ed44e3ea None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:33.603261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ca6d3-985e-49db-962b-a444ed44e3ea None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:33.603788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ca6d3-985e-49db-962b-a444ed44e3ea None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:33.605574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 938/1908] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:50:33.613402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:33.613907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:33.613995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:33.642131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:33.643503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:33.728854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 971/1909] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:50:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:33.742981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ca6d3-985e-49db-962b-a444ed44e3ea None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:33.745034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-823ca6d3-985e-49db-962b-a444ed44e3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:33.770356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ca6d3-985e-49db-962b-a444ed44e3ea None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:33.784524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:33.785172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:33.785451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:33.785770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:33.800577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:33.803903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:33.825860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 939/1910] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:34.700834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:34.715157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a708f-2546-4cf9-ad3c-62c02d7306d2 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:34.724789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:34.724789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:34.724789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:34.724789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:34.781647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:34.783248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:34.792160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 972/1911] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:37.494831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:37.506014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e580a-86a3-49ad-a553-e17ec922baaf service nova] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:37.509782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:37.510383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:37.510697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:37.510971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:37.520498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:37.521923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:37.532378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 940/1912] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:43.751546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:43.921021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:43.922378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:43.941353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8e10-e21c-4421-a5a8-670968691232 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:43.952082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ffd67-48ac-4e04-84a4-9d3d528d6b73 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:43.954839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:43.955738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:43.957198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:43.958424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] PATH_INFO: `/v3/users/f1c39aba9a904b309b5850fb1c25493e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:43.961757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c39aba9a904b309b5850fb1c25493e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:43.965435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:43.969763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:43.970723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:43.971215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:43.971699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] PATH_INFO: `/v3/users/ab3c4a4eed5c4f1e8eff76f8b5767f18` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:43.973503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3c4a4eed5c4f1e8eff76f8b5767f18)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:43.976322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:43.987933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:44.083068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:44.098581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3c4a4eed5c4f1e8eff76f8b5767f18'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.114190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3c4a4eed5c4f1e8eff76f8b5767f18'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.124641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c39aba9a904b309b5850fb1c25493e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.132618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3c4a4eed5c4f1e8eff76f8b5767f18'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.149110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3c4a4eed5c4f1e8eff76f8b5767f18'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.149945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-deaa9ca6-cfd7-4f97-9c60-18e300f968ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3c4a4eed5c4f1e8eff76f8b5767f18'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.153885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c39aba9a904b309b5850fb1c25493e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.167438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c39aba9a904b309b5850fb1c25493e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.173664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 941/1913] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:43 2022] DELETE /identity/v3/users/ab3c4a4eed5c4f1e8eff76f8b5767f18 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:44.179442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:44.180054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:44.180341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:44.193331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c39aba9a904b309b5850fb1c25493e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.194683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-52ccdd3d-68bd-4403-aefe-290c5d4e9050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c39aba9a904b309b5850fb1c25493e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:44.204320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 973/1914] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:43 2022] DELETE /identity/v3/users/f1c39aba9a904b309b5850fb1c25493e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:44.209539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:44.209906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:44.210501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:44.215408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:44.217001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:44.245828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:44.247400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:44.304008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 942/1915] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:44.321452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:44.327895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:44.353026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 974/1916] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:44.383849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:44.385413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:44.419746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99a17e-bb7e-4c42-bde5-e3542ba148a0 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:44.433668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:44.435187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:44.435676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:44.436152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:44.446866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:44.448721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:44.458697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 943/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:44.464001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894f420-3a8d-4cf0-8152-32444528eb82 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:44.467538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:44.468167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:44.468442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:44.468719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:44.478739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:44.480169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:44.491229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 975/1918] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:44.897955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:44.899619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:44.917690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa496-8aac-42d5-b627-05a32811d798 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:44.929167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:44.930923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:44.931223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:44.931837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] PATH_INFO: `/v3/projects/fc5686505633436fabee4705cd0d2bd0` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:44.933246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5686505633436fabee4705cd0d2bd0)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:44.936817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:44.968282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:44.969787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:44.994504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4d4ce-b35c-48fc-a060-2d869f3306ee service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:44.999641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:45.000520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:45.001088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:45.001365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] PATH_INFO: `/v3/projects/1c760f7ec9fe4d05a4431ff78dfe710e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:45.003238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c760f7ec9fe4d05a4431ff78dfe710e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:45.005664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:45.034520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5686505633436fabee4705cd0d2bd0', 'request_id': 'req-0adc0572-747d-405e-bd1b-9938190b746d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.037368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:45.038634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:45.045348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5686505633436fabee4705cd0d2bd0', 'request_id': 'req-0adc0572-747d-405e-bd1b-9938190b746d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.056849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5686505633436fabee4705cd0d2bd0', 'request_id': 'req-0adc0572-747d-405e-bd1b-9938190b746d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.069859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] The token cache is being invalidate because project fc5686505633436fabee4705cd0d2bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:45.070310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.071151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.072864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 944/1919] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:44 2022] DELETE /identity/v3/projects/fc5686505633436fabee4705cd0d2bd0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:45.076535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:45.078755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:45.085358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c760f7ec9fe4d05a4431ff78dfe710e', 'request_id': 'req-e1d9327e-949b-42eb-bb21-33331332dba5'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.092685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c760f7ec9fe4d05a4431ff78dfe710e', 'request_id': 'req-e1d9327e-949b-42eb-bb21-33331332dba5'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.107838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c760f7ec9fe4d05a4431ff78dfe710e', 'request_id': 'req-e1d9327e-949b-42eb-bb21-33331332dba5'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.135587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] The token cache is being invalidate because project 1c760f7ec9fe4d05a4431ff78dfe710e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:45.135880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.136669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.138715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 976/1920] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:44 2022] DELETE /identity/v3/projects/1c760f7ec9fe4d05a4431ff78dfe710e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:45.143481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:45.151766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:45.199863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc0572-747d-405e-bd1b-9938190b746d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:45.255878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9327e-949b-42eb-bb21-33331332dba5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:45.261335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:45.262063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:45.262414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:45.262785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] PATH_INFO: `/v3/users/066ae49c123b4d89b1ba339d6ad11e0c` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:45.264011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066ae49c123b4d89b1ba339d6ad11e0c)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:45.266041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:45.290530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:45.291489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:45.292057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:45.292857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] PATH_INFO: `/v3/users/55990fa80202461f84d6bb7950201bf3` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:45.295881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55990fa80202461f84d6bb7950201bf3)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:45.298297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:45.327966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066ae49c123b4d89b1ba339d6ad11e0c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.343135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066ae49c123b4d89b1ba339d6ad11e0c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.351571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066ae49c123b4d89b1ba339d6ad11e0c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.364192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066ae49c123b4d89b1ba339d6ad11e0c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.365109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066ae49c123b4d89b1ba339d6ad11e0c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.369151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55990fa80202461f84d6bb7950201bf3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.375513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 977/1921] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:45 2022] DELETE /identity/v3/users/066ae49c123b4d89b1ba339d6ad11e0c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:45.387937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55990fa80202461f84d6bb7950201bf3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.409627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55990fa80202461f84d6bb7950201bf3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.420660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55990fa80202461f84d6bb7950201bf3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.422180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55990fa80202461f84d6bb7950201bf3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:45.432772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 945/1922] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:45 2022] DELETE /identity/v3/users/55990fa80202461f84d6bb7950201bf3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:45.827241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:45.829614 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:45.879249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:45.896430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:45.898600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:45.912088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:45.936117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59d04-ed49-4f99-9dd3-541b5b5b6787 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:45.980783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc55219-08ce-480c-b6a3-6f7710e39fa8 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:45.986550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:45.987223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:45.987510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:45.987788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] PATH_INFO: `/v3/projects/23ab7d2606c14e53ab14ccdba86fd8a5` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:45.989779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ab7d2606c14e53ab14ccdba86fd8a5)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:45.992763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:45.999860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.000558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.000908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.001260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] PATH_INFO: `/v3/projects/90180b41561f4492b1a84ca2bce41d31` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.002554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90180b41561f4492b1a84ca2bce41d31)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.006123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.045942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ab7d2606c14e53ab14ccdba86fd8a5', 'request_id': 'req-7fee59e1-2920-4d3a-8a58-d134422c85b5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.052759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ab7d2606c14e53ab14ccdba86fd8a5', 'request_id': 'req-7fee59e1-2920-4d3a-8a58-d134422c85b5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.062709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90180b41561f4492b1a84ca2bce41d31', 'request_id': 'req-a23275ba-d07e-441b-8a6a-71002f802f95'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.063951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ab7d2606c14e53ab14ccdba86fd8a5', 'request_id': 'req-7fee59e1-2920-4d3a-8a58-d134422c85b5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.069058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90180b41561f4492b1a84ca2bce41d31', 'request_id': 'req-a23275ba-d07e-441b-8a6a-71002f802f95'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.077575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90180b41561f4492b1a84ca2bce41d31', 'request_id': 'req-a23275ba-d07e-441b-8a6a-71002f802f95'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.078311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] The token cache is being invalidate because project 23ab7d2606c14e53ab14ccdba86fd8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:46.078934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.080862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.083146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 946/1923] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:45 2022] DELETE /identity/v3/projects/23ab7d2606c14e53ab14ccdba86fd8a5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:46.086806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.088247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:46.092497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] The token cache is being invalidate because project 90180b41561f4492b1a84ca2bce41d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:46.092859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.093572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a23275ba-d07e-441b-8a6a-71002f802f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.095459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 978/1924] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:45 2022] DELETE /identity/v3/projects/90180b41561f4492b1a84ca2bce41d31 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:46.099771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb731c-8384-4657-bb93-49eb69d701be None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.100767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb731c-8384-4657-bb93-49eb69d701be None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.101113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb731c-8384-4657-bb93-49eb69d701be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.128467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-37cb731c-8384-4657-bb93-49eb69d701be None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:46.130682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-37cb731c-8384-4657-bb93-49eb69d701be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:46.180213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee59e1-2920-4d3a-8a58-d134422c85b5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.209477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 979/1925] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:46.219442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.219839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.220015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.232396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:46.242198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:46.243468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:46.255016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.255235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 980/1926] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:46.256030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.256173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.256270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.256270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] PATH_INFO: `/v3/users/0f7ee2b4889f42769f3e48fe94c390d9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.257541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7ee2b4889f42769f3e48fe94c390d9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.259509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.260517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:46.267215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6cf18-fc26-4ff5-bf60-dca505479e58 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.274996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.276071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.276699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.277310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.278182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:46.278489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.280132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.295659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 981/1927] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:46.300091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.312306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ab57-6cb4-4c6f-97f2-366674a13efa admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.317182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.317787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.318061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.318404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.319164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.321167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.322444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7ee2b4889f42769f3e48fe94c390d9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.331860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7ee2b4889f42769f3e48fe94c390d9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.350713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7ee2b4889f42769f3e48fe94c390d9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.357514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7ee2b4889f42769f3e48fe94c390d9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.358240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7ee2b4889f42769f3e48fe94c390d9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:46.365107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 947/1928] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:46 2022] DELETE /identity/v3/users/0f7ee2b4889f42769f3e48fe94c390d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:46.372185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 982/1929] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:46.373088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.374567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:46.444691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849859a9-1095-4cb7-9a7d-e06969fb329a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.503644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.504266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.504547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.504821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.505450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.507574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.527566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:46.533295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 948/1930] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:46.537299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.549041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace041-155a-43b5-a19a-2a2ca481de8d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.554007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.554808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.555194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.555572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.556586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.558308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.569263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 983/1931] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:46.573418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.584813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103700f-7a5d-48b9-833e-0a212ce2ceb7 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.589579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178b84f-c67b-4073-ad96-a75667eae901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.590209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178b84f-c67b-4073-ad96-a75667eae901 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.590522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178b84f-c67b-4073-ad96-a75667eae901 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.590970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178b84f-c67b-4073-ad96-a75667eae901 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.591633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178b84f-c67b-4073-ad96-a75667eae901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.593254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178b84f-c67b-4073-ad96-a75667eae901 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.605806 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 949/1932] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:46.610260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.620691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2369738-4fb5-4063-a8ac-363db492ca56 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.625912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.626428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.626673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.626974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] PATH_INFO: `/v3/projects/3d9d425215934d489fa6d0b4b4b415b6/users/3cc586c5ef474a1ba62bad4c3bc643a9/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.645182 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9d425215934d489fa6d0b4b4b415b6, user_id=3cc586c5ef474a1ba62bad4c3bc643a9, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.648603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.666985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 984/1933] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:46 2022] PUT /identity/v3/projects/3d9d425215934d489fa6d0b4b4b415b6/users/3cc586c5ef474a1ba62bad4c3bc643a9/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:46.678005 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.678306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.678590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.708340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] MFA Rules not processed for user `3cc586c5ef474a1ba62bad4c3bc643a9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:46.710301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:46.780003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 950/1934] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:46.784647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.874593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afb72-4b39-4a2e-9086-2bc81034f763 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:46.874945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:46.875546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:46.875889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:46.876235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:46.877252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:46.879421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:46.910721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 985/1935] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:46.915492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:46.932900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d036e-47be-4d9b-a784-8f46210c7a38 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.008673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.009358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.010125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.010125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.010903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.012955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.047049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 951/1936] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:46 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:47.051129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.063679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db870aa-dae3-4c01-a4c6-7c8ff72f5f7e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.065181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.067012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:47.068563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.069206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.069479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.069757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.070452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.072081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.080452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80959b7-0a4a-49c9-a336-9c5eae433bc9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.083224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 986/1937] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:47.088080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.090244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.090943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.091227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.091516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] PATH_INFO: `/v3/projects/4a60cefe6dd348dfb49ca77471e46f62` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.092717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a60cefe6dd348dfb49ca77471e46f62)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.095277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.101822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68b54-b773-441e-9d63-6348769bc025 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.106706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.107347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.107631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.107906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] PATH_INFO: `/v3/projects/199fe277fc4040c4aedf99e0a1cfe8eb/users/c1e4505d68c14ec193bf8d440689222e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.123167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199fe277fc4040c4aedf99e0a1cfe8eb, user_id=c1e4505d68c14ec193bf8d440689222e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.125841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.141035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 987/1938] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:47 2022] PUT /identity/v3/projects/199fe277fc4040c4aedf99e0a1cfe8eb/users/c1e4505d68c14ec193bf8d440689222e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:47.145414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.154038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a60cefe6dd348dfb49ca77471e46f62', 'request_id': 'req-161ab697-1518-4eb3-b219-6932baf1855f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:47.161368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a60cefe6dd348dfb49ca77471e46f62', 'request_id': 'req-161ab697-1518-4eb3-b219-6932baf1855f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:47.196296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a60cefe6dd348dfb49ca77471e46f62', 'request_id': 'req-161ab697-1518-4eb3-b219-6932baf1855f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:47.207384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:47.223226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] The token cache is being invalidate because project 4a60cefe6dd348dfb49ca77471e46f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:47.223828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:47.225353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-161ab697-1518-4eb3-b219-6932baf1855f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:47.227834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 952/1939] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:47 2022] DELETE /identity/v3/projects/4a60cefe6dd348dfb49ca77471e46f62 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:47.229374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:47.232217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3bf23-4a77-4aaa-b4da-c39572c63fbd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.233354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3bf23-4a77-4aaa-b4da-c39572c63fbd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.235502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3bf23-4a77-4aaa-b4da-c39572c63fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.263105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3ba3bf23-4a77-4aaa-b4da-c39572c63fbd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:47.264434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3ba3bf23-4a77-4aaa-b4da-c39572c63fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:47.267491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b63196-c8c3-4e06-b173-934b47ccc1b6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.365046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.366805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.373374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 953/1940] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:47.373859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.373859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.373859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.373859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.375407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.376121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.376581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.383085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 988/1941] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:47.387998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.390033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:47.405800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:47.407178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:47.407979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550d9d-c707-4417-b5f7-c4844b294a81 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.414096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19a6e9-a3f0-46fa-b4f2-32b139eb1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.415465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a6e9-a3f0-46fa-b4f2-32b139eb1e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.415917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a6e9-a3f0-46fa-b4f2-32b139eb1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.416447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19a6e9-a3f0-46fa-b4f2-32b139eb1e58 admin admin] PATH_INFO: `/v3/projects/199fe277fc4040c4aedf99e0a1cfe8eb/users/c1e4505d68c14ec193bf8d440689222e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.417933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 954/1942] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:47.419092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19a6e9-a3f0-46fa-b4f2-32b139eb1e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199fe277fc4040c4aedf99e0a1cfe8eb, user_id=c1e4505d68c14ec193bf8d440689222e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.421766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.422344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19a6e9-a3f0-46fa-b4f2-32b139eb1e58 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.432297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524ab81-4cbc-496e-bbf7-58396ade7dc3 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.442471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 989/1943] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:47 2022] PUT /identity/v3/projects/199fe277fc4040c4aedf99e0a1cfe8eb/users/c1e4505d68c14ec193bf8d440689222e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:47.453418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.453903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.454175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.492202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] MFA Rules not processed for user `c1e4505d68c14ec193bf8d440689222e`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:47.493615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:47.529078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.530886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.531383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.531842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.532974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:47.533483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.536813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.566887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 955/1944] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:50:47.575631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.592817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c92a-7604-41d2-87ae-8d92172ed821 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.601022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.603671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.604127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.605199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.607685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.611187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.629565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 990/1945] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:47.644437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.646527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:47.668755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 956/1946] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:47 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:47.672842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.716969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac090ea5-ae5e-4ab7-b7c5-a1aa0bd1ad77 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.730730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:47.744050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:47.748253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d474-3e12-48e6-9268-fc3c44167c16 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.756720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.757440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.757957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.758476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.759306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.761594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.776929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.777686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.777999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.778343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.783907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 957/1947] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:47 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:50:47.787846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.798656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0684-833d-4f90-ae24-737362d6209e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.804401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.805057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.805406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.805978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.806710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.808264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.818538 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 958/1948] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:47.822942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.832398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283da6-1f5c-41e5-b2d5-8381e0a5c0db admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.836991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.837575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.837862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.838139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.838875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.840430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.843864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.845303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.850861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 959/1949] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:47.854843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.864397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 991/1950] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:47.867461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372976-25b9-4893-a79b-610374f86183 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.882975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9a741-883b-4c9f-ba2a-40557fe4cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:47.883947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9a741-883b-4c9f-ba2a-40557fe4cf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.884290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9a741-883b-4c9f-ba2a-40557fe4cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.884628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9a741-883b-4c9f-ba2a-40557fe4cf67 admin admin] PATH_INFO: `/v3/projects/3c5b4b400190480aacaa5d0f28aff646/users/ac0b8111307e47c4acc860603f84c297/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.906631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9a741-883b-4c9f-ba2a-40557fe4cf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5b4b400190480aacaa5d0f28aff646, user_id=ac0b8111307e47c4acc860603f84c297, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:47.909428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9a741-883b-4c9f-ba2a-40557fe4cf67 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:47.940144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:47.952024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 960/1951] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:47 2022] PUT /identity/v3/projects/3c5b4b400190480aacaa5d0f28aff646/users/ac0b8111307e47c4acc860603f84c297/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:47.965417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:47.965945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:47.966415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:47.968362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cec77-f4e4-48e3-913b-a8ca5fc9ad5e service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:47.999826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] MFA Rules not processed for user `ac0b8111307e47c4acc860603f84c297`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:48.001068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:48.064057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:48.064706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:48.064992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:48.065274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] PATH_INFO: `/v3/users/3cc586c5ef474a1ba62bad4c3bc643a9` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:48.066454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc586c5ef474a1ba62bad4c3bc643a9)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:48.068433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:48.110547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 961/1952] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:48.111575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:48.145326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc586c5ef474a1ba62bad4c3bc643a9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:48.157383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc586c5ef474a1ba62bad4c3bc643a9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:48.165806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc586c5ef474a1ba62bad4c3bc643a9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:48.167883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:48.186017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc586c5ef474a1ba62bad4c3bc643a9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:48.186698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9879c14-5970-4bb7-b8f9-f7b823340db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc586c5ef474a1ba62bad4c3bc643a9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:48.193020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 992/1953] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:47 2022] DELETE /identity/v3/users/3cc586c5ef474a1ba62bad4c3bc643a9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:48.197302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:48.197584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:48.197851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:48.200170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f4ff0-e7b0-44e3-9162-d0b81e04219a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:48.220293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:48.221592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:48.279273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:48.305585 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:48.307236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:48.307747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:48.308196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:48.310477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:48.311156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 993/1954] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:48.322148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:48.324602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:48.382776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:48.383972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a564e74-6b7a-4654-8ddf-fe3ad39d81cb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:48.384352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:48.391115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:48.391814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:48.392157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:48.392374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:48.394455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 962/1955] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:48.404161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:48.405607 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:48.418098 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 994/1956] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:50:48.915376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:48.916982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:48.934019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350b90c-fc90-4150-83e4-0d726112ca35 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:48.940893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:48.941691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:48.942069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:48.942439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] PATH_INFO: `/v3/projects/3d9d425215934d489fa6d0b4b4b415b6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:48.944245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9d425215934d489fa6d0b4b4b415b6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:48.947134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:49.001246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9d425215934d489fa6d0b4b4b415b6', 'request_id': 'req-37f3a483-a030-40d6-915d-fb46e797f406'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.008091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9d425215934d489fa6d0b4b4b415b6', 'request_id': 'req-37f3a483-a030-40d6-915d-fb46e797f406'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.018633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9d425215934d489fa6d0b4b4b415b6', 'request_id': 'req-37f3a483-a030-40d6-915d-fb46e797f406'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.030762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] The token cache is being invalidate because project 3d9d425215934d489fa6d0b4b4b415b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:49.031086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.031731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.033234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 963/1957] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:48 2022] DELETE /identity/v3/projects/3d9d425215934d489fa6d0b4b4b415b6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:49.037374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:49.047119 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5fa09-8a9c-4cd1-bfe3-b99203b45211 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:49.103124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:49.103759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:49.104041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:49.104318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] PATH_INFO: `/v3/users/c1e4505d68c14ec193bf8d440689222e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:49.105476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e4505d68c14ec193bf8d440689222e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:49.107538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:49.137703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:49.156178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e4505d68c14ec193bf8d440689222e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.163523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e4505d68c14ec193bf8d440689222e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.173915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e4505d68c14ec193bf8d440689222e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.200588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e4505d68c14ec193bf8d440689222e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.201435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9e9364eb-20c8-490e-8de9-71f5bad49467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e4505d68c14ec193bf8d440689222e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.210122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 995/1958] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:49 2022] DELETE /identity/v3/users/c1e4505d68c14ec193bf8d440689222e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:49.579620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:49.581704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:49.611840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a483-a030-40d6-915d-fb46e797f406 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:49.790465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:49.792808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:49.793598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:49.794408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] PATH_INFO: `/v3/projects/199fe277fc4040c4aedf99e0a1cfe8eb` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:49.796197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=199fe277fc4040c4aedf99e0a1cfe8eb)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:49.798663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:49.882865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:49.903633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199fe277fc4040c4aedf99e0a1cfe8eb', 'request_id': 'req-99201474-d1ea-4a50-8fd5-1530cc2ebbda'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.911352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199fe277fc4040c4aedf99e0a1cfe8eb', 'request_id': 'req-99201474-d1ea-4a50-8fd5-1530cc2ebbda'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.923118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199fe277fc4040c4aedf99e0a1cfe8eb', 'request_id': 'req-99201474-d1ea-4a50-8fd5-1530cc2ebbda'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.939710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] The token cache is being invalidate because project 199fe277fc4040c4aedf99e0a1cfe8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:49.940002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.940784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-99201474-d1ea-4a50-8fd5-1530cc2ebbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:49.942398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 964/1959] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:49 2022] DELETE /identity/v3/projects/199fe277fc4040c4aedf99e0a1cfe8eb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:49.947843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:49.948139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:49.948582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:49.953256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b855c-0a08-4075-af42-10967851fcba None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:49.953540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b855c-0a08-4075-af42-10967851fcba None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:49.953839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b855c-0a08-4075-af42-10967851fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:49.973487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:49.974353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-cd9b855c-0a08-4075-af42-10967851fcba None None] MFA Rules not processed for user `ac0b8111307e47c4acc860603f84c297`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:49.976958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cd9b855c-0a08-4075-af42-10967851fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:49.977786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:50.062715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 965/1960] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:50.067411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 996/1961] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:50.068058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.069204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.069437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.094471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:50.095824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:50.104891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 966/1962] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:50.109837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.121580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9a616-a1d1-4ef8-b15b-2945a64d1971 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.126507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.127621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.127969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.128386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.129212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:50:50.129721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.131497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.143533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 997/1963] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:50:50.148331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.157785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5c1c8-730b-41cc-86e6-f4b5c9ec9450 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.163417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.164032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.164735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.164735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.165185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.167128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.196646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 967/1964] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:50 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:50.200974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.212358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b603a-bc41-4638-aa46-fe821ade27cd admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.276411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.277014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.277294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.277567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.278181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.280103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.307022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 998/1965] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:50 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:50.310875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.322707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75709b-f4bb-44a8-b6b1-4f27fd4661af admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.327266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.327865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.328140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.328412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.329049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.330653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.340586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 968/1966] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:50.344945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.355346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4414b8-16cd-41db-a0b8-ca49563a367d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.361552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029d8bc-ba01-4e1c-ae71-f86eaa76a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.362270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d8bc-ba01-4e1c-ae71-f86eaa76a4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.362720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d8bc-ba01-4e1c-ae71-f86eaa76a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.363127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d8bc-ba01-4e1c-ae71-f86eaa76a4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.363861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d8bc-ba01-4e1c-ae71-f86eaa76a4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.366088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d8bc-ba01-4e1c-ae71-f86eaa76a4b9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.383975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 999/1967] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:50.387992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.398840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153b17-c668-4189-9dc9-b2da239b9cc4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.403519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.404182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.404463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.404748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] PATH_INFO: `/v3/projects/f292f7e0ebf04013bf732a96e38b2681/users/48ba49af66bc4184877bc5e0b2ac38dd/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.421044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f292f7e0ebf04013bf732a96e38b2681, user_id=48ba49af66bc4184877bc5e0b2ac38dd, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.423753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.440473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 969/1968] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:50 2022] PUT /identity/v3/projects/f292f7e0ebf04013bf732a96e38b2681/users/48ba49af66bc4184877bc5e0b2ac38dd/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:50.451196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.451584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.452088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.474027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:50.483827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] MFA Rules not processed for user `48ba49af66bc4184877bc5e0b2ac38dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:50.485326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:50.607728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1000/1969] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:50.609141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.695244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:50.697215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e612-c5c2-411f-ab5d-0ff2a781ad9d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.704637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.705726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.706350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.711096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.712012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.714142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.748107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 970/1970] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:50 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:50.753225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.774058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50563efb-4cd0-4400-a156-0a955991fb6c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.838556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.839203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.839485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.839755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.840509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.843988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.878445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1001/1971] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:50 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:50.879606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.892773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457e6a-beea-47c9-8060-501374373fed admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.899879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.900183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.900505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.900775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.901461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.903443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.919631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 971/1972] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:50.920841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.939087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720c0c-89fd-4087-9884-8f98d6788005 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.944437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea86db-87c6-499e-bb20-c4115310add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.945038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea86db-87c6-499e-bb20-c4115310add8 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.945317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea86db-87c6-499e-bb20-c4115310add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.945588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea86db-87c6-499e-bb20-c4115310add8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:50.946231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea86db-87c6-499e-bb20-c4115310add8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:50.947908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea86db-87c6-499e-bb20-c4115310add8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:50.960787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1002/1973] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:50.965684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:50.977586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d5874-d05d-4065-90b0-07d6ecb3c190 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:50.982804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:50.983531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:50.983900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:50.984338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] PATH_INFO: `/v3/projects/4951a27a47c64ed78f85a916cd84ced2/users/baaaa502aaa34215805aa6716cc92dd3/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.000396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4951a27a47c64ed78f85a916cd84ced2, user_id=baaaa502aaa34215805aa6716cc92dd3, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.003329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.017080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 972/1974] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:50 2022] PUT /identity/v3/projects/4951a27a47c64ed78f85a916cd84ced2/users/baaaa502aaa34215805aa6716cc92dd3/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:51.028752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.029123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.029465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.057531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] MFA Rules not processed for user `baaaa502aaa34215805aa6716cc92dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:51.058752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:51.124329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1003/1975] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:51.125352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.186461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34bd9c-8088-4b4f-a3a9-b69699a74a13 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.191101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.191704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.191984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.192262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.192889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.195355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.222717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 973/1976] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:50:51 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:51.226759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.237458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520056-3661-4dae-a8cf-7172202d32d5 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.242795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:51.298421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.299060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.299337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.299606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.300224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.302106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.322882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1004/1977] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:50:51 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:50:51.326654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.337456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b2f68-d336-4df5-a5a8-7037bd8c68f5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.342236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.342862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.343142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.343412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.344044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.345626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.356143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 974/1978] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:50:51.360008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.369635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455df9f-5b3f-415f-bdb9-ed1cacc09b13 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.374404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.375083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.375400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.375677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] PATH_INFO: `/v3/projects/d196d523df5b43fe84ed84924efbfab0/users/f3affc51f8c7413c8a8b05d7cd1d1137/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.390738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d196d523df5b43fe84ed84924efbfab0, user_id=f3affc51f8c7413c8a8b05d7cd1d1137, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.393369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.406629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1005/1979] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:51 2022] PUT /identity/v3/projects/d196d523df5b43fe84ed84924efbfab0/users/f3affc51f8c7413c8a8b05d7cd1d1137/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:51.410415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.420282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49455e13-38e5-474b-937f-bf4309ad89ae admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.476916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2368e0e-9379-4f6a-afa3-a471a7d09cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.477446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368e0e-9379-4f6a-afa3-a471a7d09cbc admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.477723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368e0e-9379-4f6a-afa3-a471a7d09cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.477995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368e0e-9379-4f6a-afa3-a471a7d09cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.478648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2368e0e-9379-4f6a-afa3-a471a7d09cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.480244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2368e0e-9379-4f6a-afa3-a471a7d09cbc admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.489599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 975/1980] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:50:51.494313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.504455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddbf14-cb68-499f-a997-98aff84c5345 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.509573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.510209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.510546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.510845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] PATH_INFO: `/v3/projects/d196d523df5b43fe84ed84924efbfab0/users/f3affc51f8c7413c8a8b05d7cd1d1137/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.512708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d196d523df5b43fe84ed84924efbfab0, user_id=f3affc51f8c7413c8a8b05d7cd1d1137, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.515364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.525301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1006/1981] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:50:51 2022] PUT /identity/v3/projects/d196d523df5b43fe84ed84924efbfab0/users/f3affc51f8c7413c8a8b05d7cd1d1137/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:51.535355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.535647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.535924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.564145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] MFA Rules not processed for user `f3affc51f8c7413c8a8b05d7cd1d1137`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:51.565332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:51.569469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:51.641040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 976/1982] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:51.651994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:51.653820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:51.723730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8efc8-564a-4367-a294-9dd9a3c876ac admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:51.727875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:51.728452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:51.728729 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:51.729001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:51.738166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:51.739622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:51.749951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1007/1983] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:52.271733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:52.284364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447eb03-b8a8-4771-8bdd-dc86f314e944 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:52.288360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:52.290903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:52.290903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:52.290903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:52.352510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:52.353931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:52.363159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 977/1984] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:56.451855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:56.453256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:56.464571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856ce83-4712-431b-bd0a-1f0e90a77c80 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:56.468126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76f53-7659-451f-ba4c-8bfa66c4e258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:56.468710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76f53-7659-451f-ba4c-8bfa66c4e258 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:56.468986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76f53-7659-451f-ba4c-8bfa66c4e258 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:56.469253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76f53-7659-451f-ba4c-8bfa66c4e258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:56.522442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76f53-7659-451f-ba4c-8bfa66c4e258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:56.524531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76f53-7659-451f-ba4c-8bfa66c4e258 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:56.533362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1008/1985] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:58.072139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:58.073595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:58.138659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f0842-c26e-4c10-b382-1904d60b2b37 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:58.151118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:58.151118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:58.151118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:58.151118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] PATH_INFO: `/v3/users/4e2fed5e1e054f47ba9d59eaf4076267` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:58.151592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2fed5e1e054f47ba9d59eaf4076267)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:58.151592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:58.190775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:58.197377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2fed5e1e054f47ba9d59eaf4076267'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.204410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2fed5e1e054f47ba9d59eaf4076267'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.218069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2fed5e1e054f47ba9d59eaf4076267'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.225109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2fed5e1e054f47ba9d59eaf4076267'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.225944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2fed5e1e054f47ba9d59eaf4076267'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.231920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 978/1986] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:58 2022] DELETE /identity/v3/users/4e2fed5e1e054f47ba9d59eaf4076267 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:58.236272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:58.236713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:58.236800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:58.244292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:58.258648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:58.259840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:58.326749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1009/1987] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:58.337599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:58.339310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:58.408633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3491a32-ad22-47a7-8463-83bb462a3d61 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:58.412403 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:58.413053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:58.413337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:58.413634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:58.432635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:58.435133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:58.448897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 979/1988] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:58.813380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:58.814937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:58.835342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba378d-075b-4340-a359-611efc2bd31d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:58.846036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:58.846807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:58.847090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:58.848716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] PATH_INFO: `/v3/projects/f51582815e5f48cf9a62353c398e0aa8` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:58.849941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51582815e5f48cf9a62353c398e0aa8)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:58.874366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:58.908543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:58.910152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:58.933486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc82784-3aed-41d4-bd9d-4a56f28ce11c service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:58.939481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51582815e5f48cf9a62353c398e0aa8', 'request_id': 'req-b14cd536-49d3-43a2-9d90-10e404f84284'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.945960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51582815e5f48cf9a62353c398e0aa8', 'request_id': 'req-b14cd536-49d3-43a2-9d90-10e404f84284'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.958400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51582815e5f48cf9a62353c398e0aa8', 'request_id': 'req-b14cd536-49d3-43a2-9d90-10e404f84284'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.978844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] The token cache is being invalidate because project f51582815e5f48cf9a62353c398e0aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:58.979223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.980708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:58.982626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1010/1989] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:58 2022] DELETE /identity/v3/projects/f51582815e5f48cf9a62353c398e0aa8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:58.987006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:58.988883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.028182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:59.029604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.030540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.030936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] PATH_INFO: `/v3/users/48ba49af66bc4184877bc5e0b2ac38dd` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.032294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ba49af66bc4184877bc5e0b2ac38dd)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:59.035210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:59.080274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd536-49d3-43a2-9d90-10e404f84284 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:59.087049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:59.087756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.088517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.088891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] PATH_INFO: `/v3/users/47b429baa608475eb81903cf548d3afe` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.090339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b429baa608475eb81903cf548d3afe)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:59.092749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:59.104269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ba49af66bc4184877bc5e0b2ac38dd'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.114774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ba49af66bc4184877bc5e0b2ac38dd'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.126640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:59.150226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ba49af66bc4184877bc5e0b2ac38dd'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.155111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:59.158827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ba49af66bc4184877bc5e0b2ac38dd'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.159779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-aabd5a2b-9842-41c8-9f18-e19101b004b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ba49af66bc4184877bc5e0b2ac38dd'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.173861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 980/1990] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:58 2022] DELETE /identity/v3/users/48ba49af66bc4184877bc5e0b2ac38dd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:50:59.175795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725395e1-38ed-438c-8201-0a765875219b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.176178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725395e1-38ed-438c-8201-0a765875219b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.176555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725395e1-38ed-438c-8201-0a765875219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.203522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-725395e1-38ed-438c-8201-0a765875219b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:59.205351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-725395e1-38ed-438c-8201-0a765875219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.219222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b429baa608475eb81903cf548d3afe'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.236480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b429baa608475eb81903cf548d3afe'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.251061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b429baa608475eb81903cf548d3afe'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.272092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b429baa608475eb81903cf548d3afe'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.274353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b429baa608475eb81903cf548d3afe'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.276261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 981/1991] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:50:59.282091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1011/1992] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:50:58 2022] DELETE /identity/v3/users/47b429baa608475eb81903cf548d3afe => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:59.291186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725395e1-38ed-438c-8201-0a765875219b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:59.292677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-725395e1-38ed-438c-8201-0a765875219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.364914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725395e1-38ed-438c-8201-0a765875219b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:59.443094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:59.444383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.445749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.446136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.449222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.539233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:50:59.561709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:59.562642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fbbf2-00a4-4183-bc4b-211b73ba0f68 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:59.574337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 982/1993] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:50:59.643791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:59.646434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.680099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c1b1d-fc79-4709-afd3-15a7106e4cd9 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:50:59.687127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:50:59.687972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.688256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.688661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] PATH_INFO: `/v3/projects/ee5db9fb5a594224859c1fe245152276` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.690477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5db9fb5a594224859c1fe245152276)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:50:59.692600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:50:59.749198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5db9fb5a594224859c1fe245152276', 'request_id': 'req-149884a4-aaeb-460c-9838-65995572e985'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.755628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5db9fb5a594224859c1fe245152276', 'request_id': 'req-149884a4-aaeb-460c-9838-65995572e985'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.783848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5db9fb5a594224859c1fe245152276', 'request_id': 'req-149884a4-aaeb-460c-9838-65995572e985'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.801177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] The token cache is being invalidate because project ee5db9fb5a594224859c1fe245152276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:50:59.801471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.803721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-149884a4-aaeb-460c-9838-65995572e985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:50:59.808852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1012/1994] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:59 2022] DELETE /identity/v3/projects/ee5db9fb5a594224859c1fe245152276 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:50:59.814681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.815392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.816178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.851492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:59.852936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.923329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 983/1995] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:59.941262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:50:59.941803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:50:59.942262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:50:59.960842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:50:59.963451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.966218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:50:59.967901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:50:59.977784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1013/1996] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:50:59.992685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.001737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136fb79-f062-403c-b7c0-5dc1e999760f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.009452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.014774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28c755-4f0a-49a3-ab6c-73ad0bc2849a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.016181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.016181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.016379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] PATH_INFO: `/v3/projects/f292f7e0ebf04013bf732a96e38b2681` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.019575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f292f7e0ebf04013bf732a96e38b2681)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.022219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.023410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.034834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.034834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.034834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.034834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:00.034834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.034834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.048309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1014/1997] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:51:00.049812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.066529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bde6f2-7f62-43d5-a86b-f5f78e23eea8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.077028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.077714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.078585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.078902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.080161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.083188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.101037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f292f7e0ebf04013bf732a96e38b2681', 'request_id': 'req-42dc5188-24df-4742-a1e9-affc217b83f0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.109759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f292f7e0ebf04013bf732a96e38b2681', 'request_id': 'req-42dc5188-24df-4742-a1e9-affc217b83f0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.121723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1015/1998] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:00 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:00.121914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f292f7e0ebf04013bf732a96e38b2681', 'request_id': 'req-42dc5188-24df-4742-a1e9-affc217b83f0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.123128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.133823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] The token cache is being invalidate because project f292f7e0ebf04013bf732a96e38b2681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:00.134364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.135518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.137578 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 984/1999] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:50:59 2022] DELETE /identity/v3/projects/f292f7e0ebf04013bf732a96e38b2681 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:00.141500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.143077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:00.180185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:00.201353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a08bd-2c28-455d-bd38-07e000f86ba9 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.208705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.209831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.209967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.210219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.210954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.212948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.245662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1016/2000] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:00 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:00.246286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5188-24df-4742-a1e9-affc217b83f0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.248438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.248739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.249446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.249866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.250231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:00.250341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] PATH_INFO: `/v3/users/baaaa502aaa34215805aa6716cc92dd3` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.252244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaaa502aaa34215805aa6716cc92dd3)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.254259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.263991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2e60-9b0b-48fa-a71b-58adf9b42d47 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.272038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.272726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.273198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.273328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.273877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.274850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:00.276156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.295833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1017/2001] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:00.297926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.324679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b34f6-8d59-4d78-9a3c-2c263557db90 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.332168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.333886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.334393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.334947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.336172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.338342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.356525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaaa502aaa34215805aa6716cc92dd3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.378989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1018/2002] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:00.381894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.389370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaaa502aaa34215805aa6716cc92dd3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.402357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80764-5fc9-4422-9f99-9afafc688605 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.417997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.420860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.423422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaaa502aaa34215805aa6716cc92dd3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.423699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.423996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] PATH_INFO: `/v3/projects/e91ee7dbebe34c30806374cb91e109ed/users/1c186e65fc734405b22f9893c7bf3d39/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.435800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaaa502aaa34215805aa6716cc92dd3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.437871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3af7759b-65c2-44fd-a24e-0cdadd438f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaaa502aaa34215805aa6716cc92dd3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:00.452489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91ee7dbebe34c30806374cb91e109ed, user_id=1c186e65fc734405b22f9893c7bf3d39, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.452995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 985/2003] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:00 2022] DELETE /identity/v3/users/baaaa502aaa34215805aa6716cc92dd3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:00.453105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.477670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1019/2004] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:00 2022] PUT /identity/v3/projects/e91ee7dbebe34c30806374cb91e109ed/users/1c186e65fc734405b22f9893c7bf3d39/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:00.481057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.481362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.481644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.513064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] MFA Rules not processed for user `1c186e65fc734405b22f9893c7bf3d39`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:00.514301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:00.593720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 986/2005] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:00.604830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.608294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:00.688536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d522b-04eb-4a04-afac-6bd52f6c6cca admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.693279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.693911 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.694259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.694465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.695283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.697455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.729848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1020/2006] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:00 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:00.734231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.753765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb2e6-cbff-46ed-af5e-ce639dca3fc0 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.851934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.852572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.852861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.853165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.853855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.877921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.906814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 987/2007] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:00 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:00.909345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.922676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af700e-d7a8-4683-8ae4-61974aadfa21 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.927651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.928426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.928783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.929131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.929893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:00.931916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:00.949318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1021/2008] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:00.953197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:00.964818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274c4ee-0b15-4a28-a9f3-ecaf6cdd8e47 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:00.970291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:00.970999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:00.971286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:00.971563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] PATH_INFO: `/v3/projects/37edb321e1ba437db8852d2db5a9df13/users/da171c9e5b154d3a922201d025a5de73/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:00.976690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:01.012943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37edb321e1ba437db8852d2db5a9df13, user_id=da171c9e5b154d3a922201d025a5de73, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:01.016160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:01.041602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 988/2009] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:00 2022] PUT /identity/v3/projects/37edb321e1ba437db8852d2db5a9df13/users/da171c9e5b154d3a922201d025a5de73/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:01.045842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:01.061469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2c2dc-41cd-4588-977d-d5f37af21af6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:01.158788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:01.161414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:01.181102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:01.183788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:01.185221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:01.185597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:01.187007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:01.191207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:01.207102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:01.222066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1022/2010] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:01.226650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:01.241628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538b09-e42c-407a-9135-35964daf2462 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:01.248332 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfac4a-f0e6-4aac-b947-32bd86950a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:01.249088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfac4a-f0e6-4aac-b947-32bd86950a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:01.249692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfac4a-f0e6-4aac-b947-32bd86950a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:01.251309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfac4a-f0e6-4aac-b947-32bd86950a15 admin admin] PATH_INFO: `/v3/projects/37edb321e1ba437db8852d2db5a9df13/users/da171c9e5b154d3a922201d025a5de73/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:01.252420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfac4a-f0e6-4aac-b947-32bd86950a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37edb321e1ba437db8852d2db5a9df13, user_id=da171c9e5b154d3a922201d025a5de73, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:01.268330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfac4a-f0e6-4aac-b947-32bd86950a15 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:01.295530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1023/2011] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:01 2022] PUT /identity/v3/projects/37edb321e1ba437db8852d2db5a9df13/users/da171c9e5b154d3a922201d025a5de73/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:01.299506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39efbb6-4ad9-430d-aa7a-18eb5a6a707e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:01.303982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:01.306159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:01.306829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:01.373682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] MFA Rules not processed for user `da171c9e5b154d3a922201d025a5de73`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:01.375031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:01.413905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:01.414786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:01.415078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:01.415358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] PATH_INFO: `/v3/projects/4951a27a47c64ed78f85a916cd84ced2` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:01.416646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4951a27a47c64ed78f85a916cd84ced2)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:01.418918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:01.534165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4951a27a47c64ed78f85a916cd84ced2', 'request_id': 'req-014683ac-3f27-4276-ad02-a65ba6c57769'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.535547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1024/2012] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:01.546912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4951a27a47c64ed78f85a916cd84ced2', 'request_id': 'req-014683ac-3f27-4276-ad02-a65ba6c57769'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.549006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:01.550440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:01.562997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4951a27a47c64ed78f85a916cd84ced2', 'request_id': 'req-014683ac-3f27-4276-ad02-a65ba6c57769'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.580540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] The token cache is being invalidate because project 4951a27a47c64ed78f85a916cd84ced2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:01.580901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.582483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.588769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 989/2013] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:01 2022] DELETE /identity/v3/projects/4951a27a47c64ed78f85a916cd84ced2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:01.590186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:01.593637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:01.654312 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:01.678259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f056b-b2f1-48c6-8c22-5be9099bb7e5 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:01.703330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014683ac-3f27-4276-ad02-a65ba6c57769 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:01.709116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:01.709116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:01.709343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:01.709636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] PATH_INFO: `/v3/users/f3affc51f8c7413c8a8b05d7cd1d1137` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:01.710958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3affc51f8c7413c8a8b05d7cd1d1137)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:01.713595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:01.780722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:01.781424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:01.781787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:01.782747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:01.784948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:01.798379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3affc51f8c7413c8a8b05d7cd1d1137'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.811743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3affc51f8c7413c8a8b05d7cd1d1137'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.831338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3affc51f8c7413c8a8b05d7cd1d1137'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.840259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3affc51f8c7413c8a8b05d7cd1d1137'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.841104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3affc51f8c7413c8a8b05d7cd1d1137'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:01.852677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 990/2014] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:01 2022] DELETE /identity/v3/users/f3affc51f8c7413c8a8b05d7cd1d1137 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:01.880741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:01.917049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:01.919238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:01.933725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1025/2015] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:51:02.283014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:02.284615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:02.380944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b684-b729-49d9-8ceb-128c216aea4a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:02.389287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:02.390137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.390695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.391057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] PATH_INFO: `/v3/projects/d196d523df5b43fe84ed84924efbfab0` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.392359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d196d523df5b43fe84ed84924efbfab0)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:02.395009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:02.482454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:02.488981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd196d523df5b43fe84ed84924efbfab0', 'request_id': 'req-0bc0103c-4d23-4984-b368-a796a12080e8'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:02.513592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd196d523df5b43fe84ed84924efbfab0', 'request_id': 'req-0bc0103c-4d23-4984-b368-a796a12080e8'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:02.515741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:02.526362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcb882-73c8-4016-9212-1b4d1608d2f2 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:02.526814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd196d523df5b43fe84ed84924efbfab0', 'request_id': 'req-0bc0103c-4d23-4984-b368-a796a12080e8'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:02.552216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] The token cache is being invalidate because project d196d523df5b43fe84ed84924efbfab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:02.552612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:02.553678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-0bc0103c-4d23-4984-b368-a796a12080e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:02.557410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 991/2016] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:02 2022] DELETE /identity/v3/projects/d196d523df5b43fe84ed84924efbfab0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:02.563822 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff5f3-95de-4cb9-8ddf-829309e4b8bb None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.564179 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff5f3-95de-4cb9-8ddf-829309e4b8bb None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.564532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff5f3-95de-4cb9-8ddf-829309e4b8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.604986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-fdaff5f3-95de-4cb9-8ddf-829309e4b8bb None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:02.606155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fdaff5f3-95de-4cb9-8ddf-829309e4b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:02.627013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da171c9e5b154d3a922201d025a5de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37edb321e1ba437db8852d2db5a9df13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:02.627794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.628090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.628369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.629033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:02.629344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:02.630999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:02.674035 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1026/2017] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:02.676390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:02.678103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:02.694390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f12d1a-927d-4d8d-9c7c-84e62d90d380 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:02.704508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da171c9e5b154d3a922201d025a5de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37edb321e1ba437db8852d2db5a9df13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:02.705139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.705425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.705700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.711242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:02.717694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:02.752285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 992/2018] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:02.756335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.756627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.756895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.779583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1027/2019] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:02 2022] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:02.783873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:02.789048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:02.790319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:02.902020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 993/2020] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:02.904556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:02.922844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107595d-a348-4946-bc79-a43f4a8bf929 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:02.930231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:02.931151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.931429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.931704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.932362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:02.932663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:02.934265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:02.937637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807124-436d-4a8b-9487-dfb068942c2e tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:02.947902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da171c9e5b154d3a922201d025a5de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37edb321e1ba437db8852d2db5a9df13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:02.948538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.948825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.949249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.949937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:02.950397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:02.952175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:02.954649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 994/2021] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:02.958987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:02.967569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1028/2022] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:02.977318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7514-7a70-4cef-81cf-206c40e391ae admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:02.983174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:02.983950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:02.984241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:02.984518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:02.985306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:02.987787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.025261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.040856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 995/2023] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:02 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:03.041853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cac57-c778-49b1-9001-fb62dbea2a15 tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.044755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.104130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:03.142131 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:03.166163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2647db3-52ff-44b3-9fca-99293d436401 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.174460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:03.175199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.175483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.175761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.176393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:03.179817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.191843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da171c9e5b154d3a922201d025a5de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37edb321e1ba437db8852d2db5a9df13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:03.193216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.195917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.196526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] PATH_INFO: `/v3/projects/e4049b0eee5e418bbb9fd5d7e29b8a1a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.199207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e4049b0eee5e418bbb9fd5d7e29b8a1a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:03.202160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.216763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 996/2024] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:03 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:03.220525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.232767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c80c8-2d3b-47cb-a296-978ac8c7048d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.240087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:03.240953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.241420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.242458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.243208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:03.244903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.261898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 997/2025] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:03.263157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.278928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34ac2f-9ed1-4045-80ce-c5699d7e89d5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.298434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4049b0eee5e418bbb9fd5d7e29b8a1a', 'request_id': 'req-51a000ff-b1d0-4896-9ff6-be233dfe601f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:03.317862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4049b0eee5e418bbb9fd5d7e29b8a1a', 'request_id': 'req-51a000ff-b1d0-4896-9ff6-be233dfe601f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:03.344110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4049b0eee5e418bbb9fd5d7e29b8a1a', 'request_id': 'req-51a000ff-b1d0-4896-9ff6-be233dfe601f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:03.376932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] The token cache is being invalidate because project e4049b0eee5e418bbb9fd5d7e29b8a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:03.377283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:03.377912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:03.383645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1029/2026] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:03 2022] DELETE /identity/v3/projects/e4049b0eee5e418bbb9fd5d7e29b8a1a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:03.417457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146079e-9990-4025-8888-d3412ccd8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:03.419471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146079e-9990-4025-8888-d3412ccd8d27 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.419758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146079e-9990-4025-8888-d3412ccd8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.420036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146079e-9990-4025-8888-d3412ccd8d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.422959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146079e-9990-4025-8888-d3412ccd8d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:03.426040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146079e-9990-4025-8888-d3412ccd8d27 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.439795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 998/2027] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:03.443759 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.445414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:03.463645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a000ff-b1d0-4896-9ff6-be233dfe601f tempest-VolumeQuotaClassesTest-1332664057 tempest-VolumeQuotaClassesTest-1332664057-project-admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.470260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:03.471057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.471342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.471616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] PATH_INFO: `/v3/projects/5818c03d933c494090bebdd7fbf64e82/users/4abf223042bf4400866c2a2c77371603/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.511822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5818c03d933c494090bebdd7fbf64e82, user_id=4abf223042bf4400866c2a2c77371603, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:03.514789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.543737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1030/2028] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:03 2022] PUT /identity/v3/projects/5818c03d933c494090bebdd7fbf64e82/users/4abf223042bf4400866c2a2c77371603/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:03.557752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.558633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.560222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.640721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] MFA Rules not processed for user `4abf223042bf4400866c2a2c77371603`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:03.641960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:03.771991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 999/2029] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:03.777656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.795803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.804667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:03.883076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabed00-0bc1-4c76-af41-9ebb3c2f8891 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.888859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:03.889687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:03.890910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:03.891365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:03.892287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:03.895656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:03.899807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:03.927903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1031/2030] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:03 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:03.932052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:03.932623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04d51-418e-44d9-b006-780410bb0de5 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:03.976421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:04.004008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.004879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.005532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.005532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] PATH_INFO: `/v3/users/1c186e65fc734405b22f9893c7bf3d39` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.007001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c186e65fc734405b22f9893c7bf3d39)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.008890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2a25-ac5d-4a59-bcb2-5bb1dcf2400f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.009664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.015217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.015898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.016185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.016457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.017092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.019048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.045095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1032/2031] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:03 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:04.049830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.061683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261e2a-7b89-43b5-b0f8-07705b28d6f4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.068124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.069286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.070999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.071280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.072091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.074069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.074445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c186e65fc734405b22f9893c7bf3d39'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:04.087627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c186e65fc734405b22f9893c7bf3d39'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:04.094313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1033/2032] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:04.095799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.105974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c186e65fc734405b22f9893c7bf3d39'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:04.111013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05d89b-31bb-4560-9706-4585409c7083 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.114753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c186e65fc734405b22f9893c7bf3d39'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:04.115567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-05fcc32c-2192-4101-9754-4da9c48acf1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c186e65fc734405b22f9893c7bf3d39'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:04.117841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.119025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.119808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.120372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.122766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.124851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.126639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1000/2033] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:03 2022] DELETE /identity/v3/users/1c186e65fc734405b22f9893c7bf3d39 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:04.129046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.129348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.129768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.139591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1034/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:04.149760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.152256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:04.155575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:04.157144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:04.173577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1def6-3cf4-40c2-a234-19875dd0a292 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.235753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1001/2035] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:04.244293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.245846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:04.257098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:04.268723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28f93-5a80-4bb9-bfa4-4c804a062ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.269602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28f93-5a80-4bb9-bfa4-4c804a062ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.269876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28f93-5a80-4bb9-bfa4-4c804a062ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.270148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28f93-5a80-4bb9-bfa4-4c804a062ddb admin admin] PATH_INFO: `/v3/projects/ef869021b0af4aa887b178bff72e2801/users/1525b294f0834452a4604a0db5925adc/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.290017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28f93-5a80-4bb9-bfa4-4c804a062ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef869021b0af4aa887b178bff72e2801, user_id=1525b294f0834452a4604a0db5925adc, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.292724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28f93-5a80-4bb9-bfa4-4c804a062ddb admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.310685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1035/2036] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:04 2022] PUT /identity/v3/projects/ef869021b0af4aa887b178bff72e2801/users/1525b294f0834452a4604a0db5925adc/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:04.320765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.321701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.322021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.326673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c18f-2807-48b7-8a7d-bac319b7bd43 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.354919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] MFA Rules not processed for user `1525b294f0834452a4604a0db5925adc`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:04.356191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:04.423085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.424464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.424874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.425106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.440331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1036/2037] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:04.445572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.473254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:04.502209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.504186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.516157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1002/2038] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:51:04.534556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9bfc8-b2a6-48d7-8aae-2a7532ddfde5 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.539799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.540426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.541090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.541090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.541825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.543850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.578742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1037/2039] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:04 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:04.583024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.594242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2917-c05f-44be-8e77-0c32bbcc2565 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.668905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.669816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.670248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.670700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.671472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.673734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.701336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1003/2040] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:04 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:04.705682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.716350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d544-30d8-4767-b1cc-a21857936091 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.721292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.721961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.722328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.722721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.723438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.725121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.735928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1038/2041] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:04.740743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.748025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:04.752107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a52ee-f4da-475e-bd9a-31f5d6bef08a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.758042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.759018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.759303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.759617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] PATH_INFO: `/v3/projects/019ac8bf8c5c4e0d810372367f3f9ad6/users/d9de3de392c54a07bf14e6d5da888df7/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.777505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] RBAC: Authorizing `identity:create_grant(project_id=019ac8bf8c5c4e0d810372367f3f9ad6, user_id=d9de3de392c54a07bf14e6d5da888df7, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.780203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.794592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1004/2042] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:04 2022] PUT /identity/v3/projects/019ac8bf8c5c4e0d810372367f3f9ad6/users/d9de3de392c54a07bf14e6d5da888df7/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:04.798565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.811852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74477e-c263-419f-88af-282ecfbba770 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.885410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1f0ab-e7d4-44a5-9892-0738cf01b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.886041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1f0ab-e7d4-44a5-9892-0738cf01b66a admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.886336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1f0ab-e7d4-44a5-9892-0738cf01b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.886632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1f0ab-e7d4-44a5-9892-0738cf01b66a admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.887307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1f0ab-e7d4-44a5-9892-0738cf01b66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.888927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1f0ab-e7d4-44a5-9892-0738cf01b66a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.899393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1039/2043] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:04.903517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:04.914639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0af1d-528b-408d-acc2-c2b491f3293a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:04.919457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:04.920125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.920405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.920678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] PATH_INFO: `/v3/projects/019ac8bf8c5c4e0d810372367f3f9ad6/users/d9de3de392c54a07bf14e6d5da888df7/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.922573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] RBAC: Authorizing `identity:create_grant(project_id=019ac8bf8c5c4e0d810372367f3f9ad6, user_id=d9de3de392c54a07bf14e6d5da888df7, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:04.925232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:04.937786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1005/2044] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:04 2022] PUT /identity/v3/projects/019ac8bf8c5c4e0d810372367f3f9ad6/users/d9de3de392c54a07bf14e6d5da888df7/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:04.948988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:04.949510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:04.949872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:04.978848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] MFA Rules not processed for user `d9de3de392c54a07bf14e6d5da888df7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:04.980174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:05.049382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1040/2045] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:05.061233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:05.063040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:05.131645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d76cb-83db-4740-b236-fe6fdc41284a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:05.135992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:05.136713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:05.137184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:05.137531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:05.149838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:05.151386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:05.162537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1006/2046] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:05.191688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:05.193530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:05.208237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:05.224675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:05.227592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:05.257902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab419ef7-a224-4783-9358-109daf9061e0 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:05.263790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:05.264422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:05.266361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:05.266361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:05.267647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:05.279177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4994328-34a7-4bc8-a5d8-2f5e9a1234f0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:05.283884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:05.284595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:05.284941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:05.285278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] PATH_INFO: `/v3/projects/e91ee7dbebe34c30806374cb91e109ed` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:05.287869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91ee7dbebe34c30806374cb91e109ed)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:05.289664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:05.343982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91ee7dbebe34c30806374cb91e109ed', 'request_id': 'req-78ae9426-5056-4327-96d0-af0f1a16864a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.350589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91ee7dbebe34c30806374cb91e109ed', 'request_id': 'req-78ae9426-5056-4327-96d0-af0f1a16864a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.350959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:05.353028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:05.360769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91ee7dbebe34c30806374cb91e109ed', 'request_id': 'req-78ae9426-5056-4327-96d0-af0f1a16864a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.363279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1007/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:05.382087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] The token cache is being invalidate because project e91ee7dbebe34c30806374cb91e109ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:05.383743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.384436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.386203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1041/2048] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:05 2022] DELETE /identity/v3/projects/e91ee7dbebe34c30806374cb91e109ed => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:05.390318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:05.402768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1dde1-0e79-4f4d-a35d-d6c1e9b9ae2d service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:05.469674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:05.470431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:05.470597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:05.470911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] PATH_INFO: `/v3/users/da171c9e5b154d3a922201d025a5de73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:05.472124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da171c9e5b154d3a922201d025a5de73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:05.474843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:05.488277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:05.539581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da171c9e5b154d3a922201d025a5de73'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.550698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da171c9e5b154d3a922201d025a5de73'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.567445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da171c9e5b154d3a922201d025a5de73'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.577231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da171c9e5b154d3a922201d025a5de73'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.578063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f0fa015-7f02-4c4a-8393-ce2b3433a5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da171c9e5b154d3a922201d025a5de73'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:05.584657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1008/2049] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:05 2022] DELETE /identity/v3/users/da171c9e5b154d3a922201d025a5de73 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:05.945540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:05.947039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:05.972245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae9426-5056-4327-96d0-af0f1a16864a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.034851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.035578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.035929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.036292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] PATH_INFO: `/v3/projects/37edb321e1ba437db8852d2db5a9df13` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.037494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=37edb321e1ba437db8852d2db5a9df13)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.039539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.085320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:06.089611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37edb321e1ba437db8852d2db5a9df13', 'request_id': 'req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:06.097595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37edb321e1ba437db8852d2db5a9df13', 'request_id': 'req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:06.105631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37edb321e1ba437db8852d2db5a9df13', 'request_id': 'req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:06.116351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] The token cache is being invalidate because project 37edb321e1ba437db8852d2db5a9df13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:06.117545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:06.118494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-43da8cc7-ffa1-4585-b5a8-c7a9ca7167ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:06.120403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1042/2050] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:05 2022] DELETE /identity/v3/projects/37edb321e1ba437db8852d2db5a9df13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:06.125832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513624-0199-4246-9b6c-589dd59af40e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.126126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513624-0199-4246-9b6c-589dd59af40e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.126586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513624-0199-4246-9b6c-589dd59af40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.149779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-79513624-0199-4246-9b6c-589dd59af40e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:06.151712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-79513624-0199-4246-9b6c-589dd59af40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:06.239798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1009/2051] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:06.248008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.248299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.248737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.272859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:06.274067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:06.283899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1043/2052] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:06.289658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513624-0199-4246-9b6c-589dd59af40e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.302175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513624-0199-4246-9b6c-589dd59af40e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.307857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.308471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.308747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.309017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.309663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:06.309963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.311584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.323259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1010/2053] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:51:06.328722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.338201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4dcc-a050-440d-9057-fd621f9d84cb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.342887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.343475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.343757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.344233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.344878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.346931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.374380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1044/2054] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:06 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:06.378454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.388374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503b14-bde5-4b2c-81a7-b71c522e6b61 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.443057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.443663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.443943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.444219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.444885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.446801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.470360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1011/2055] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:06.474662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.485521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e9b5-2475-4e0f-af48-742fc6dba0a2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.490419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.491129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.491474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.491829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.492483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.494184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.506319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1045/2056] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:06.510487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.516877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:06.521155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f09ec-a579-47c5-965e-e5d2b2c56701 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.528373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282cd7-f388-4338-b535-26113da3c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.529195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282cd7-f388-4338-b535-26113da3c068 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.529662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282cd7-f388-4338-b535-26113da3c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.530413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282cd7-f388-4338-b535-26113da3c068 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.531111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44282cd7-f388-4338-b535-26113da3c068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.533007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44282cd7-f388-4338-b535-26113da3c068 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.544800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1012/2057] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:06.549012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.559238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f107-c2b4-4974-aff9-cd9964dd7cfa admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.563896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.564537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.564817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.565093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] PATH_INFO: `/v3/projects/35a6bb16f3c94bd1a3cee90a01fdb65f/users/1852facf04fc41bb9e571276dd692d30/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.579316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a6bb16f3c94bd1a3cee90a01fdb65f, user_id=1852facf04fc41bb9e571276dd692d30, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.581956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.596848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1046/2058] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:06 2022] PUT /identity/v3/projects/35a6bb16f3c94bd1a3cee90a01fdb65f/users/1852facf04fc41bb9e571276dd692d30/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:06.611501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.611788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.612067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.638850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] MFA Rules not processed for user `1852facf04fc41bb9e571276dd692d30`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:06.640062 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:06.704356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1013/2059] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:06.716360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:06.718041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:06.794704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e057a89-c68b-4335-aabf-2fbfe303dcdb admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:06.799988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abe07c-8938-4286-aacd-ec2599ed8343 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:06.800774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abe07c-8938-4286-aacd-ec2599ed8343 service glance] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:06.801047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abe07c-8938-4286-aacd-ec2599ed8343 service glance] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:06.801317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abe07c-8938-4286-aacd-ec2599ed8343 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:06.810269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abe07c-8938-4286-aacd-ec2599ed8343 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:06.811736 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abe07c-8938-4286-aacd-ec2599ed8343 service glance] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:06.820367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1047/2060] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:08.402087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:08.403663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:08.479111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbe7b-34d0-4e8e-a292-aaa069b39143 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:08.483784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:08.484421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:08.484707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:08.484987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] PATH_INFO: `/v3/users/4abf223042bf4400866c2a2c77371603` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:08.486144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abf223042bf4400866c2a2c77371603)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:08.488543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:08.546085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abf223042bf4400866c2a2c77371603'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:08.560519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abf223042bf4400866c2a2c77371603'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:08.573874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abf223042bf4400866c2a2c77371603'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:08.581400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abf223042bf4400866c2a2c77371603'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:08.582111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abf223042bf4400866c2a2c77371603'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:08.588013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1014/2061] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:08 2022] DELETE /identity/v3/users/4abf223042bf4400866c2a2c77371603 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:08.592694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:08.593230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:08.593230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:08.617963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:08.619195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:08.661550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:08.677915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1048/2062] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:08.688539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:08.689945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:08.695346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:08.751600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636627-a30a-42aa-9adf-aef4ad648616 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:08.755256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:08.755866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:08.756148 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:08.756428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:08.765335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:08.766790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:08.776548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1015/2063] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:09.053285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:09.054766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:09.066979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1f51-6eaf-4ffb-9941-ce360cf76500 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:09.071541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:09.072176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:09.072457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:09.072727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] PATH_INFO: `/v3/projects/5818c03d933c494090bebdd7fbf64e82` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:09.073837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5818c03d933c494090bebdd7fbf64e82)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:09.075848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:09.124800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5818c03d933c494090bebdd7fbf64e82', 'request_id': 'req-20655bd5-6aa2-4d68-acf0-aab078fd719d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.130748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5818c03d933c494090bebdd7fbf64e82', 'request_id': 'req-20655bd5-6aa2-4d68-acf0-aab078fd719d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.138624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5818c03d933c494090bebdd7fbf64e82', 'request_id': 'req-20655bd5-6aa2-4d68-acf0-aab078fd719d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.149195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] The token cache is being invalidate because project 5818c03d933c494090bebdd7fbf64e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:09.149484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.150099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.151577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1049/2064] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:09 2022] DELETE /identity/v3/projects/5818c03d933c494090bebdd7fbf64e82 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:09.156167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:09.165885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578664db-3f57-46d5-982f-a9961a301a6f service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:09.225419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:09.226051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:09.226329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:09.226736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] PATH_INFO: `/v3/users/1525b294f0834452a4604a0db5925adc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:09.227928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1525b294f0834452a4604a0db5925adc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:09.230018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:09.276819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1525b294f0834452a4604a0db5925adc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.285294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1525b294f0834452a4604a0db5925adc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.297517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1525b294f0834452a4604a0db5925adc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.304205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1525b294f0834452a4604a0db5925adc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.304856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1525b294f0834452a4604a0db5925adc'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.311125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1016/2065] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:09 2022] DELETE /identity/v3/users/1525b294f0834452a4604a0db5925adc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:09.676698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:09.678270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:09.700348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20655bd5-6aa2-4d68-acf0-aab078fd719d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:09.764331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:09.765020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:09.765309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:09.765592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] PATH_INFO: `/v3/projects/ef869021b0af4aa887b178bff72e2801` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:09.767390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef869021b0af4aa887b178bff72e2801)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:09.769319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:09.834926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef869021b0af4aa887b178bff72e2801', 'request_id': 'req-03d2584d-68d0-4d19-b24f-3cae212b5b4d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.841625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef869021b0af4aa887b178bff72e2801', 'request_id': 'req-03d2584d-68d0-4d19-b24f-3cae212b5b4d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.850052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef869021b0af4aa887b178bff72e2801', 'request_id': 'req-03d2584d-68d0-4d19-b24f-3cae212b5b4d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.863076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] The token cache is being invalidate because project ef869021b0af4aa887b178bff72e2801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:09.863368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.864031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:09.867132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1050/2066] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:09 2022] DELETE /identity/v3/projects/ef869021b0af4aa887b178bff72e2801 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:09.870309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:09.871813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:09.885920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc86a4-1e93-456b-a578-ea50d385ad93 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:09.910675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:09.962641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:09.962641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:09.962641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:09.962641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] PATH_INFO: `/v3/users/d9de3de392c54a07bf14e6d5da888df7` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:09.963055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9de3de392c54a07bf14e6d5da888df7)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:09.963523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:10.045242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9de3de392c54a07bf14e6d5da888df7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.057667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9de3de392c54a07bf14e6d5da888df7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.072972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9de3de392c54a07bf14e6d5da888df7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.081109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9de3de392c54a07bf14e6d5da888df7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.082075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cd6199bc-c377-4d0b-a01a-b1694de5d169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9de3de392c54a07bf14e6d5da888df7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.089851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1017/2067] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:09 2022] DELETE /identity/v3/users/d9de3de392c54a07bf14e6d5da888df7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:10.403722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:10.405311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:10.416385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:10.420843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2584d-68d0-4d19-b24f-3cae212b5b4d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:10.491642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:10.492630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:10.493052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:10.493611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] PATH_INFO: `/v3/projects/019ac8bf8c5c4e0d810372367f3f9ad6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:10.495390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019ac8bf8c5c4e0d810372367f3f9ad6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:10.497451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:10.560141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019ac8bf8c5c4e0d810372367f3f9ad6', 'request_id': 'req-3d72888b-6173-4883-87a8-e1d876b36774'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.566183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019ac8bf8c5c4e0d810372367f3f9ad6', 'request_id': 'req-3d72888b-6173-4883-87a8-e1d876b36774'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.575173 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019ac8bf8c5c4e0d810372367f3f9ad6', 'request_id': 'req-3d72888b-6173-4883-87a8-e1d876b36774'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.590032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] The token cache is being invalidate because project 019ac8bf8c5c4e0d810372367f3f9ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:10.590424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.591330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3d72888b-6173-4883-87a8-e1d876b36774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:10.593033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1051/2068] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:10 2022] DELETE /identity/v3/projects/019ac8bf8c5c4e0d810372367f3f9ad6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:10.598796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:10.599209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:10.599487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:10.621506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:10.622800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:10.685978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1018/2069] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:10.695352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:10.695892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:10.695892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:10.716495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:10.717745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:10.730668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1052/2070] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:10.731955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:10.747317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a6b0b-2097-4e7b-9c2c-67164725fee1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:10.766795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:10.767429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:10.768209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:10.768209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:10.768614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:10.768911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:10.770506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:10.794110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1019/2071] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:10.798641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:10.809039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298606c-d5cf-42a2-a42f-2ed0a6c9abee None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:10.813996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:10.814595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:10.815170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:10.815283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:10.815902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:10.817818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:10.849948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1053/2072] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:10 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:10.854591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:10.870022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907670-8472-443e-ac71-92af71da6d02 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:10.916941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:10.952640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:10.953597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:10.953974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:10.954323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:10.955106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:10.957124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:10.983804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1020/2073] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:10 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:10.987909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:10.999157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0fa2-2bbc-411a-986f-095de28de6dc admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:11.003930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:11.004537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:11.004818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:11.005097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:11.005746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:11.007976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:11.018119 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1054/2074] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:11.022073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:11.031951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6628c-de84-4d06-a6a5-7f68c5f65b13 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:11.036592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930623a7-1a42-4fd7-9faf-b441b7d07c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:11.037184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930623a7-1a42-4fd7-9faf-b441b7d07c5d admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:11.037479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930623a7-1a42-4fd7-9faf-b441b7d07c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:11.037736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930623a7-1a42-4fd7-9faf-b441b7d07c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:11.038399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930623a7-1a42-4fd7-9faf-b441b7d07c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:11.040021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930623a7-1a42-4fd7-9faf-b441b7d07c5d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:11.049660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1021/2075] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:11.053623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:11.064466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f15fd-5ccc-4050-adcf-273addd70fd9 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:11.069544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:11.070945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:11.071227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:11.071499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] PATH_INFO: `/v3/projects/05a680bab4714593a5264580d7bda868/users/ce279518203e4761a498fa1c5b2cb5a4/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:11.086143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a680bab4714593a5264580d7bda868, user_id=ce279518203e4761a498fa1c5b2cb5a4, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:11.088814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:11.101347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1055/2076] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:11 2022] PUT /identity/v3/projects/05a680bab4714593a5264580d7bda868/users/ce279518203e4761a498fa1c5b2cb5a4/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:11.112387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66800e-33b6-4c32-8965-024c31b8f0da None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:11.112681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66800e-33b6-4c32-8965-024c31b8f0da None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:11.112963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66800e-33b6-4c32-8965-024c31b8f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:11.142469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-7b66800e-33b6-4c32-8965-024c31b8f0da None None] MFA Rules not processed for user `ce279518203e4761a498fa1c5b2cb5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:11.143837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7b66800e-33b6-4c32-8965-024c31b8f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:11.211939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1022/2077] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:11.223569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:11.225304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:11.261357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:11.286590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6c49f-0122-417f-8926-f6bae701e1e5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:11.290297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:11.290946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:11.291227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:11.291500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:11.299608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:11.301042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:11.310440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1056/2078] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:21.208882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:21.306545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=12 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:29.841015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b8d5-a60f-420a-be36-0e9fd53da66b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:29.841528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b8d5-a60f-420a-be36-0e9fd53da66b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:29.841702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b8d5-a60f-420a-be36-0e9fd53da66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:29.860737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a7d5b8d5-a60f-420a-be36-0e9fd53da66b None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:29.862033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a7d5b8d5-a60f-420a-be36-0e9fd53da66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:29.922151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1023/2079] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:51:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:29.964630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:29.966149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:30.034283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339503be-2efd-40a2-8042-6a080b45efe3 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:30.039216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:30.039902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:30.040185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:30.040453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:30.051701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:30.053309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:30.062993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1057/2080] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:51:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:30.667031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25799a-9ba3-4bf5-a7f3-3aa6ffca4ae1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:30.667317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25799a-9ba3-4bf5-a7f3-3aa6ffca4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:30.667593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25799a-9ba3-4bf5-a7f3-3aa6ffca4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:30.690778 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1a25799a-9ba3-4bf5-a7f3-3aa6ffca4ae1 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:30.692009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1a25799a-9ba3-4bf5-a7f3-3aa6ffca4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:30.699332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1024/2081] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 12 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:30.715129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:30.726656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba19f7-c15d-4cef-8ed8-4cda8907c1a5 service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:30.743714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:30.744442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:30.744726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:30.745000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:30.753827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:30.755535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:30.766771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1058/2082] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:31.082734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eef68e-d9b3-46e1-ac1a-afabbe44365f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:31.083242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eef68e-d9b3-46e1-ac1a-afabbe44365f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:31.083526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eef68e-d9b3-46e1-ac1a-afabbe44365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:31.104159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-13eef68e-d9b3-46e1-ac1a-afabbe44365f None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:31.105501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-13eef68e-d9b3-46e1-ac1a-afabbe44365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:31.113464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1025/2083] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:31.128866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:31.143220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0477-5e79-4238-97ed-0bdb3a62a7b4 service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:31.153205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:31.154069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:31.154496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:31.155113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:31.165333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:31.167442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:31.181097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1059/2084] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:31.586146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:31.586437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:31.586775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:31.612189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:31.613639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:31.621860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1026/2085] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 12 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:31.634361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:31.645390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf4db2-6e0a-4bf6-8abe-2b46f1ddb56d service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:31.650720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:31.651320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:31.651596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:31.651869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:31.660217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:31.662063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:31.673144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1060/2086] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:51:33.051383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.053711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.130843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b766a7-6d88-4a68-858e-3843392d89e5 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.136769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.137406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.137702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.138009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] PATH_INFO: `/v3/users/134faab760d04e3ba537619281c316c9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.139273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134faab760d04e3ba537619281c316c9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:33.141273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:33.193263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134faab760d04e3ba537619281c316c9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.201774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134faab760d04e3ba537619281c316c9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.216018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134faab760d04e3ba537619281c316c9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.222935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134faab760d04e3ba537619281c316c9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.223669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134faab760d04e3ba537619281c316c9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.229597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1027/2087] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:33 2022] DELETE /identity/v3/users/134faab760d04e3ba537619281c316c9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:33.399973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.412112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa565-4fda-4ccf-bbe8-494dc981a3ff service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.496006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.496649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.496931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.497201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] PATH_INFO: `/v3/projects/06451ebec8a947829019e1fea6636bc6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.499025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06451ebec8a947829019e1fea6636bc6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:33.501709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:33.566918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06451ebec8a947829019e1fea6636bc6', 'request_id': 'req-f06f5ccb-1c60-4225-a4ff-46f1e41add88'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.569455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:33.580008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06451ebec8a947829019e1fea6636bc6', 'request_id': 'req-f06f5ccb-1c60-4225-a4ff-46f1e41add88'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.580999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.583059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.590727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06451ebec8a947829019e1fea6636bc6', 'request_id': 'req-f06f5ccb-1c60-4225-a4ff-46f1e41add88'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.594661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:33.598320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb905-1a81-49be-90f8-bea4f0281e25 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.607340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] The token cache is being invalidate because project 06451ebec8a947829019e1fea6636bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:33.607879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.608547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f06f5ccb-1c60-4225-a4ff-46f1e41add88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.611345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1061/2088] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:33 2022] DELETE /identity/v3/projects/06451ebec8a947829019e1fea6636bc6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:33.616247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8b34-5e5e-4f09-9814-4e76469c6f2d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.616849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8b34-5e5e-4f09-9814-4e76469c6f2d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.617440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8b34-5e5e-4f09-9814-4e76469c6f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.639544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1e5d8b34-5e5e-4f09-9814-4e76469c6f2d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:33.640772 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1e5d8b34-5e5e-4f09-9814-4e76469c6f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.686541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.687223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.687519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.687829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] PATH_INFO: `/v3/users/ce279518203e4761a498fa1c5b2cb5a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.688992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce279518203e4761a498fa1c5b2cb5a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:33.690977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:33.723599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1062/2089] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:33.732020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.732313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.732586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.740705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce279518203e4761a498fa1c5b2cb5a4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.747330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce279518203e4761a498fa1c5b2cb5a4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.752183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:33.753386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.760437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce279518203e4761a498fa1c5b2cb5a4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.761958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1063/2090] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:33.766107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.767558 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce279518203e4761a498fa1c5b2cb5a4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.768238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-be6d1d6f-80d1-4268-ab00-28e747207234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce279518203e4761a498fa1c5b2cb5a4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:33.774271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1028/2091] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:33 2022] DELETE /identity/v3/users/ce279518203e4761a498fa1c5b2cb5a4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:33.774901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6525-8c81-43ee-b8b6-71eea302ab6c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.779183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.779477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.779761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.798262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:33.799591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.834581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.835224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.835500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.835767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.836409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:33.836709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:33.839011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:33.850053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1064/2092] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:33.855376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.857051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.858988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1029/2093] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:33.869245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.870451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66fd9c-d6e7-4d0e-9601-4812cf60c9b7 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.870663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:33.875302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.876464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.876764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.877215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.881141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:33.883130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:33.900136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:33.914628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1065/2094] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:33 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:33.919228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:33.935816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53016-2b2b-4278-98d0-206e61c9d034 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.970159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:33.985058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf434a-c9a6-4705-8214-72509137bace admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:33.990181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.990916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.991201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.991478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:33.992110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:33.993523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:33.994106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:33.994233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:33.994448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:33.994761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.005019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.006817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.019543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1066/2095] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:33 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:34.023249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1030/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:34.023779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.035166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f81f-3c32-4f29-b1f6-77b869cad343 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.040006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.040605 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.040924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.041226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.041899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.043541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.053512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1067/2097] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:34.058150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.068295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51932f8-44bc-4659-a2b2-90d9f6027d81 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.074244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265903bd-cbeb-4b26-bce0-232c035e47a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.074902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265903bd-cbeb-4b26-bce0-232c035e47a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.075172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265903bd-cbeb-4b26-bce0-232c035e47a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.075453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265903bd-cbeb-4b26-bce0-232c035e47a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.076095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265903bd-cbeb-4b26-bce0-232c035e47a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.077687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265903bd-cbeb-4b26-bce0-232c035e47a1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.090728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1031/2098] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:34.094799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.104862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd109a-973b-4641-8841-043cfade8639 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.109974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.110661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.110946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.111218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] PATH_INFO: `/v3/projects/e5a7f5c2f3e34684bd5b8161ba77014c/users/327a8f72755c4645a854d86d881de107/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.126436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a7f5c2f3e34684bd5b8161ba77014c, user_id=327a8f72755c4645a854d86d881de107, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.129118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.145826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1068/2099] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:34 2022] PUT /identity/v3/projects/e5a7f5c2f3e34684bd5b8161ba77014c/users/327a8f72755c4645a854d86d881de107/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:34.157194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.157510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.157864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.161755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.165439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.200287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] MFA Rules not processed for user `327a8f72755c4645a854d86d881de107`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:34.202102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.266015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2615b8c-bd7a-42ea-9b68-fd3eb8748ce3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.272438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.273073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.273477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.276712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] PATH_INFO: `/v3/users/ac0b8111307e47c4acc860603f84c297` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.277373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0b8111307e47c4acc860603f84c297)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.279748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.284281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1032/2100] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:34.300127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.301647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.344270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0b8111307e47c4acc860603f84c297'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.354163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0b8111307e47c4acc860603f84c297'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.361798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0b8111307e47c4acc860603f84c297'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.373686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:34.375691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0b8111307e47c4acc860603f84c297'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.376471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-34e091fc-5995-4e44-8bb5-d5223090e1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0b8111307e47c4acc860603f84c297'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.383859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1069/2101] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:34 2022] DELETE /identity/v3/users/ac0b8111307e47c4acc860603f84c297 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:34.388092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.388485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.388815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.394134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f484-fb9b-4513-b96d-53049fdf4267 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.409490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:34.410737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.427247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:34.472811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.473535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.473804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.474077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.475847 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.491527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1070/2102] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:34.492289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.494506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.506223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7711-f4e9-4e80-922c-2499629b65f6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.511662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.512719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.513004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.513273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] PATH_INFO: `/v3/projects/05a680bab4714593a5264580d7bda868` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.514384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a680bab4714593a5264580d7bda868)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.516347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.536700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.538324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.548723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1033/2103] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:34.549898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.551205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.572892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a680bab4714593a5264580d7bda868', 'request_id': 'req-dd506fec-ba3a-4755-b435-0667464a4cb0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.579163 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a680bab4714593a5264580d7bda868', 'request_id': 'req-dd506fec-ba3a-4755-b435-0667464a4cb0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.589401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a680bab4714593a5264580d7bda868', 'request_id': 'req-dd506fec-ba3a-4755-b435-0667464a4cb0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.601185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] The token cache is being invalidate because project 05a680bab4714593a5264580d7bda868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:34.601597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.602433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-dd506fec-ba3a-4755-b435-0667464a4cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:34.605030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1071/2104] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:34 2022] DELETE /identity/v3/projects/05a680bab4714593a5264580d7bda868 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:34.610352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c997a1-c612-431f-9ef0-aed698980549 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.610663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c997a1-c612-431f-9ef0-aed698980549 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.610966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c997a1-c612-431f-9ef0-aed698980549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.614355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cde01-546d-4ba1-8ec0-1adefb949235 service nova] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.633468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-44c997a1-c612-431f-9ef0-aed698980549 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:34.634861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-44c997a1-c612-431f-9ef0-aed698980549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.667254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.667862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.668145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.668430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.670210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.678998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:34.705278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1072/2105] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:34.713225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.713510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.713802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.736786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:34.737985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:34.747198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1073/2106] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:34.751943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.763217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.764603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f62d-fb29-433a-8ca8-71aed112d5ed None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.764794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.770641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.771253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.771530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.771806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.772460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:34.772766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.774353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.776245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1034/2107] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:34.789685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1074/2108] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:34.791541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.801249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29a4af-52fb-402a-82f7-aa6daee4bbd1 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.806553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.807899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.808570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.808835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.809587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.812661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:34.854753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1035/2109] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:34 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:34.858829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:34.885260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce138e-d08f-413b-b1c1-9a6de03aeeaf admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:34.934641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:34.988693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:34.989444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:34.989716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:34.990156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:34.990872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:34.992855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:35.000777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:35.002524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:35.018415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da2baf-5fa8-4e31-b592-3fbf415f16e9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:35.023910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:35.024562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:35.024854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:35.025137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] PATH_INFO: `/v3/projects/3c5b4b400190480aacaa5d0f28aff646` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:35.026850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5b4b400190480aacaa5d0f28aff646)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:35.029497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1075/2110] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:34 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:35.029616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:35.033582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:35.045748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d800-7631-43b4-93e5-65526371550f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:35.050388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:35.051044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:35.051323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:35.051624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:35.052374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:35.053980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:35.065346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1076/2111] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:35.069338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:35.079460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa8890-edc7-4c96-90df-7477bbfdde7e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:35.082549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5b4b400190480aacaa5d0f28aff646', 'request_id': 'req-d46912c6-1b58-44b6-b366-ffe3674b1259'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:35.089930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5b4b400190480aacaa5d0f28aff646', 'request_id': 'req-d46912c6-1b58-44b6-b366-ffe3674b1259'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:35.099512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5b4b400190480aacaa5d0f28aff646', 'request_id': 'req-d46912c6-1b58-44b6-b366-ffe3674b1259'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:35.112263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] The token cache is being invalidate because project 3c5b4b400190480aacaa5d0f28aff646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:35.112972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:35.113543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:35.115306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1036/2112] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:34 2022] DELETE /identity/v3/projects/3c5b4b400190480aacaa5d0f28aff646 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:35.139020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e141-675a-4b75-98eb-b4ed0293a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:35.139646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e141-675a-4b75-98eb-b4ed0293a8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:35.139924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e141-675a-4b75-98eb-b4ed0293a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:35.140194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e141-675a-4b75-98eb-b4ed0293a8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:35.140847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9e141-675a-4b75-98eb-b4ed0293a8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:35.142474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9e141-675a-4b75-98eb-b4ed0293a8d8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:35.154787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1077/2113] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:35.159127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:35.160709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:35.175045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46912c6-1b58-44b6-b366-ffe3674b1259 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:35.179812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:35.180501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:35.180781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:35.181056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] PATH_INFO: `/v3/projects/b472ae939daa4de3be6b5238b4016d65/users/d31b28f57b4b4d9ea012abb8b6259623/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:35.207458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b472ae939daa4de3be6b5238b4016d65, user_id=d31b28f57b4b4d9ea012abb8b6259623, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:35.211423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:35.225360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1037/2114] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:35 2022] PUT /identity/v3/projects/b472ae939daa4de3be6b5238b4016d65/users/d31b28f57b4b4d9ea012abb8b6259623/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:35.236714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:35.237226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:35.237706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:35.273887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] MFA Rules not processed for user `d31b28f57b4b4d9ea012abb8b6259623`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:35.275095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:35.350707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1078/2115] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:35.361484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:35.363177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:35.406696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:35.421612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9d7e-a78f-4d6e-a5c1-52d3b20f74d0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:35.425203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34932493-00e9-4d63-9904-0335628af51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:35.425838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932493-00e9-4d63-9904-0335628af51d service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:35.426113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932493-00e9-4d63-9904-0335628af51d service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:35.426383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932493-00e9-4d63-9904-0335628af51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:35.434574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34932493-00e9-4d63-9904-0335628af51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:35.436013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34932493-00e9-4d63-9904-0335628af51d service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:35.444466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1038/2116] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:41.603267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:41.635228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:41.670822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0ceb-9ee3-43c0-8da3-7ab74d3d26ae None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:41.675702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:41.676283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:41.676561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:41.676832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] PATH_INFO: `/v3/users/d31b28f57b4b4d9ea012abb8b6259623` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:41.677977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31b28f57b4b4d9ea012abb8b6259623)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:41.679925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:41.730699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31b28f57b4b4d9ea012abb8b6259623'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:41.737844 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31b28f57b4b4d9ea012abb8b6259623'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:41.744651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31b28f57b4b4d9ea012abb8b6259623'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:41.755954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31b28f57b4b4d9ea012abb8b6259623'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:41.756659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31b28f57b4b4d9ea012abb8b6259623'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:41.762662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1079/2117] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:41 2022] DELETE /identity/v3/users/d31b28f57b4b4d9ea012abb8b6259623 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:41.767246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:41.767604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:41.767701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:41.786771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:41.787950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:41.846511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1039/2118] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:41.856756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:41.858228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:41.917229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57472-a2fc-4e2c-aa0e-4b1e137f8ffa admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:41.921886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a77dd5-4afe-4505-b929-11c441897db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:41.922540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a77dd5-4afe-4505-b929-11c441897db0 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:41.922856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a77dd5-4afe-4505-b929-11c441897db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:41.923234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a77dd5-4afe-4505-b929-11c441897db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:41.932510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a77dd5-4afe-4505-b929-11c441897db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:41.933872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a77dd5-4afe-4505-b929-11c441897db0 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:41.943006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1080/2119] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:42.207443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.209002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:42.222396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253c232-6f3b-4f25-86e5-154b8752115c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.227384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.228113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.228457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.228797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] PATH_INFO: `/v3/projects/b472ae939daa4de3be6b5238b4016d65` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.230279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b472ae939daa4de3be6b5238b4016d65)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.233263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.284033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b472ae939daa4de3be6b5238b4016d65', 'request_id': 'req-6dda799d-9866-4125-8f7f-a2a30919c2c4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:42.291235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b472ae939daa4de3be6b5238b4016d65', 'request_id': 'req-6dda799d-9866-4125-8f7f-a2a30919c2c4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:42.304245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b472ae939daa4de3be6b5238b4016d65', 'request_id': 'req-6dda799d-9866-4125-8f7f-a2a30919c2c4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:42.319836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] The token cache is being invalidate because project b472ae939daa4de3be6b5238b4016d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:42.320510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:42.321252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-6dda799d-9866-4125-8f7f-a2a30919c2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:42.323938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1040/2120] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:42 2022] DELETE /identity/v3/projects/b472ae939daa4de3be6b5238b4016d65 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:42.328304 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.328579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.328850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.350504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:42.351728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:42.413651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:42.432175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1081/2121] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:42.443593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.443873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.444170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.464018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:42.465131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:42.472761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1041/2122] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:42.476798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.486425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b77551-4cc5-49b9-a2a9-2a2015080a6a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.491589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.492333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.492609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.492981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.493638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:42.493936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.496083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.508808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1082/2123] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:51:42.513747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.523430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412573-ddf6-4eeb-9dcc-aa99af363563 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.528296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.528886 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.529182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.529433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.530053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.531953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.560777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1042/2124] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:42 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:42.562383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.572156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df043-2752-47e0-a5c1-c5b407f452b7 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.626227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.626871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.627117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.627384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.627991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.629923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.650245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1083/2125] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:42 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:42.654471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.665006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf3bdd-67fa-473f-b974-a6223dd443e4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.669732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.670320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.670598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.670904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.671542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.673168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.684565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1043/2126] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:42.688434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.698015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd88eb-f218-492a-9fbc-5c6ffaeefc44 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.703126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2f08-dd1d-4da0-a9a8-7596fcc738a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.703707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2f08-dd1d-4da0-a9a8-7596fcc738a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.703984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2f08-dd1d-4da0-a9a8-7596fcc738a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.704261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2f08-dd1d-4da0-a9a8-7596fcc738a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.704907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2f08-dd1d-4da0-a9a8-7596fcc738a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.706484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2f08-dd1d-4da0-a9a8-7596fcc738a5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.719804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1084/2127] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:42.720973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.732491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59bfc7-95b6-46cd-90fc-2ab49d11a0ed admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.737405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.738057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.738339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.738705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] PATH_INFO: `/v3/projects/27e2b3cedbb541c5829705d86efc15a9/users/28e52b26eb384784b0ed6e93d8b1c608/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.754876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e2b3cedbb541c5829705d86efc15a9, user_id=28e52b26eb384784b0ed6e93d8b1c608, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.759112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.782410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1044/2128] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:42 2022] PUT /identity/v3/projects/27e2b3cedbb541c5829705d86efc15a9/users/28e52b26eb384784b0ed6e93d8b1c608/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:42.785238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.785638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.785916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.815078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] MFA Rules not processed for user `28e52b26eb384784b0ed6e93d8b1c608`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:42.816462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:42.898459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1085/2129] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:42.904376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:42.906086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:42.911500 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:42.965766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dee1c-ccdc-40a4-a430-b7c0890bd30c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:42.969542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8afd-a692-4766-9202-44e12cd41c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:42.970224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8afd-a692-4766-9202-44e12cd41c80 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:42.970454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8afd-a692-4766-9202-44e12cd41c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:42.970763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8afd-a692-4766-9202-44e12cd41c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:42.978851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb8afd-a692-4766-9202-44e12cd41c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:42.980776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb8afd-a692-4766-9202-44e12cd41c80 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:42.989504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1045/2130] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:44.033953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:44.034649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.084713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:44.101769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc385b75-b7f5-489d-ba51-78a9f7e9d54f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:44.106381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:44.107031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.107308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.107580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] PATH_INFO: `/v3/users/327a8f72755c4645a854d86d881de107` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.108679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327a8f72755c4645a854d86d881de107)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:44.110587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:44.155720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327a8f72755c4645a854d86d881de107'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.164201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327a8f72755c4645a854d86d881de107'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.171055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327a8f72755c4645a854d86d881de107'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.182967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327a8f72755c4645a854d86d881de107'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.184086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327a8f72755c4645a854d86d881de107'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.189842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1086/2131] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:44 2022] DELETE /identity/v3/users/327a8f72755c4645a854d86d881de107 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:44.194290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.194755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.194872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.214439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:44.215843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.275108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1046/2132] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:44.284773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:44.286193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.344588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644914-f30b-4dee-bb8c-fc90578bbf14 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:44.348159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:44.348752 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.349026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.349294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.358646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:44.360072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:44.372101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1087/2133] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:44.572704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:44.574834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.587715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca864-a8a2-4a2f-b977-52fa8ee0179b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:44.592892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:44.593519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.593798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.594069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] PATH_INFO: `/v3/users/1852facf04fc41bb9e571276dd692d30` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.595598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1852facf04fc41bb9e571276dd692d30)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:44.597506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:44.671664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1852facf04fc41bb9e571276dd692d30'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.673187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:44.676921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.683852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1852facf04fc41bb9e571276dd692d30'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.693937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10125a56-c43f-452b-863d-c79a1aabf688 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:44.700125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1852facf04fc41bb9e571276dd692d30'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.701082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:44.702578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.702941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.703454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] PATH_INFO: `/v3/projects/e5a7f5c2f3e34684bd5b8161ba77014c` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.705106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a7f5c2f3e34684bd5b8161ba77014c)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:44.707364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:44.709888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1852facf04fc41bb9e571276dd692d30'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.711128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c194ea70-fb7a-4910-be06-9a5a8b71d60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1852facf04fc41bb9e571276dd692d30'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.724303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1047/2134] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:44 2022] DELETE /identity/v3/users/1852facf04fc41bb9e571276dd692d30 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:44.728903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.729233 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.729506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.752816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:44.754153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.791789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:44.795936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a7f5c2f3e34684bd5b8161ba77014c', 'request_id': 'req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.812650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a7f5c2f3e34684bd5b8161ba77014c', 'request_id': 'req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.830357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a7f5c2f3e34684bd5b8161ba77014c', 'request_id': 'req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.835243 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:44.862125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] The token cache is being invalidate because project e5a7f5c2f3e34684bd5b8161ba77014c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:44.862125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.862125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2d57fc89-64cc-4dd5-bd41-6fb7fce26cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:44.864270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1088/2135] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:44 2022] DELETE /identity/v3/projects/e5a7f5c2f3e34684bd5b8161ba77014c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:44.869144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa018-ab17-468c-a48e-c2bb5859de11 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.869441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa018-ab17-468c-a48e-c2bb5859de11 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.869698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aa018-ab17-468c-a48e-c2bb5859de11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.879097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1048/2136] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:44.891893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:44.893554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.895988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-636aa018-ab17-468c-a48e-c2bb5859de11 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:44.897224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-636aa018-ab17-468c-a48e-c2bb5859de11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:44.963937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d908-9603-422c-b9e0-2f64b3f30286 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:44.964294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1089/2137] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:44.975120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:44.975398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:44.975665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:44.996648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:44.997866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.006103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1090/2138] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:45.010275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.019356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f901e0-5db4-4632-a457-226865496fe2 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.020083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.020982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.021271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.021541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.023308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.024155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.024735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.025012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.025292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.025922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:45.026219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.027890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.035751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.037191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.040046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1091/2139] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:45.044701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.049678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1049/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:45.054508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18219d-c11a-4307-9938-8b060a2e6313 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.061259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.061862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.062143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.062417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.063083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.064998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.092087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1092/2141] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:45.096320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.107302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8581-488f-4166-bff0-17b51ec55404 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.168320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.168998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.169280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.169556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.170201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.172160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.196151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1050/2142] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:45.200209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.210555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d60c1-8f56-4711-a177-013903e43007 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.215284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.215808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.216089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.216435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.217101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.218698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.232816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1093/2143] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:45.233637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.243961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2670d87-f733-4146-b062-49aa106d79f3 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.250719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc3a03-006f-492d-9dbf-1daca91ec363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.251394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc3a03-006f-492d-9dbf-1daca91ec363 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.251744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc3a03-006f-492d-9dbf-1daca91ec363 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.252029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc3a03-006f-492d-9dbf-1daca91ec363 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.252669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc3a03-006f-492d-9dbf-1daca91ec363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.254267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc3a03-006f-492d-9dbf-1daca91ec363 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.255664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:45.266454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1051/2144] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:45.270633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.282428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0cb47-5707-4484-8071-777943a8d718 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.289145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.289822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.290105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.290384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] PATH_INFO: `/v3/projects/3c072c4c95874de8b27a64df7fb20566/users/c7c1edcce89f41658210ce4992ddf2d6/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.311428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c072c4c95874de8b27a64df7fb20566, user_id=c7c1edcce89f41658210ce4992ddf2d6, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.316201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.333558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1094/2145] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:45 2022] PUT /identity/v3/projects/3c072c4c95874de8b27a64df7fb20566/users/c7c1edcce89f41658210ce4992ddf2d6/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:45.349271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.349561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.349840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.358507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.360365 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.382215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] MFA Rules not processed for user `c7c1edcce89f41658210ce4992ddf2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:45.383457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.426986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283d8da-2a63-442d-8b93-d490143acc01 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.432323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.432950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.433228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.433526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] PATH_INFO: `/v3/projects/35a6bb16f3c94bd1a3cee90a01fdb65f` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.434662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a6bb16f3c94bd1a3cee90a01fdb65f)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.436562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.453302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:45.456794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1052/2146] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:45.461117 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.472394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cfaf1-c5df-4919-8b1b-be3d5630790d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.485570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a6bb16f3c94bd1a3cee90a01fdb65f', 'request_id': 'req-d9fa6c50-bfa3-42c8-b12a-27df32e92990'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:45.491856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a6bb16f3c94bd1a3cee90a01fdb65f', 'request_id': 'req-d9fa6c50-bfa3-42c8-b12a-27df32e92990'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:45.499342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a6bb16f3c94bd1a3cee90a01fdb65f', 'request_id': 'req-d9fa6c50-bfa3-42c8-b12a-27df32e92990'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:45.512672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] The token cache is being invalidate because project 35a6bb16f3c94bd1a3cee90a01fdb65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:45.512976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:45.513621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-d9fa6c50-bfa3-42c8-b12a-27df32e92990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:45.515188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1095/2147] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:45 2022] DELETE /identity/v3/projects/35a6bb16f3c94bd1a3cee90a01fdb65f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:45.519895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25429f9-cf10-4a95-8444-6be2fbbc99db None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.520181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25429f9-cf10-4a95-8444-6be2fbbc99db None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.520488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25429f9-cf10-4a95-8444-6be2fbbc99db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.534736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.535528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.535818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.536096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.536727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.538826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.540733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f25429f9-cf10-4a95-8444-6be2fbbc99db None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:45.541964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f25429f9-cf10-4a95-8444-6be2fbbc99db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.551650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1096/2148] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:45.559722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.560067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.560317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.572671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1053/2149] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:45.573671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.575375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.579678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:45.580945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:45.643297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91196f-3594-431d-9315-8ee71ad63a9d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.645700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1097/2150] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:45.649984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.652860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.653696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.653978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.654245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.654900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.656866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.659860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a511e-8323-4c91-b589-e9a1fca8ff84 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.664556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.665159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.665442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.665743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.666401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:45.666810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.669031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.676447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:45.685260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1098/2151] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:45.685797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1054/2152] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:45.687976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.688098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.698156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42309f78-53a2-4b99-b5fa-c7f87d0e677f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.698509 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beb1d8-2e88-4ef0-a803-c20977fd7164 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.703806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.703962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.704444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.704728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.705003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.705148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.705552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.705659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.706046 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.706876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.707564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.708853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.720837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1099/2153] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:45.724771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.735803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc5c2-d89c-448c-9b21-7c3ea27f02a4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.740707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.741366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.741645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.741946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] PATH_INFO: `/v3/projects/afbd7e0c319c4213bd584b3a047c9cc0/users/9deec1b492e24833bb330c12019f8307/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.743361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1055/2154] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:45.747356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.760063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbd7e0c319c4213bd584b3a047c9cc0, user_id=9deec1b492e24833bb330c12019f8307, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.763507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.777784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1100/2155] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:45 2022] PUT /identity/v3/projects/afbd7e0c319c4213bd584b3a047c9cc0/users/9deec1b492e24833bb330c12019f8307/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:45.781340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.827905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ad61-edd5-4fe6-8160-872ee9a50cf0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.838419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:45.855208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f73e7-04f3-42b0-bae2-10203676002a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.863635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.864266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.864550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.864830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.865585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.867400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.878104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1101/2156] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:45.882241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.893896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db983-6c1e-4fff-bc17-ce4e92667ee8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.900662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b696e4a-72b2-4378-8395-f47e4a88600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.901351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b696e4a-72b2-4378-8395-f47e4a88600e admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.901626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b696e4a-72b2-4378-8395-f47e4a88600e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.901901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b696e4a-72b2-4378-8395-f47e4a88600e admin admin] PATH_INFO: `/v3/projects/afbd7e0c319c4213bd584b3a047c9cc0/users/9deec1b492e24833bb330c12019f8307/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.904651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b696e4a-72b2-4378-8395-f47e4a88600e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbd7e0c319c4213bd584b3a047c9cc0, user_id=9deec1b492e24833bb330c12019f8307, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.906120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:45.906900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.907474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.907588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b696e4a-72b2-4378-8395-f47e4a88600e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.907925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.909024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:45.911488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:45.921206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1102/2157] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:45 2022] PUT /identity/v3/projects/afbd7e0c319c4213bd584b3a047c9cc0/users/9deec1b492e24833bb330c12019f8307/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:45.940111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:45.940397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:45.940884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:45.951910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1056/2158] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:45.953913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:45.967564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433f43-4ab0-41e9-a216-60eb26ac6523 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:45.977862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] MFA Rules not processed for user `9deec1b492e24833bb330c12019f8307`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:45.979341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:46.038131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:46.040370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.040370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.040370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.040370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:46.042031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:46.053986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1057/2159] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:46.058317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:46.069925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31f100-fdc8-4bfb-b79a-3225b2c28b47 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:46.076013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:46.076629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.076911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.077188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.078066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:46.079658 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:46.085977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:46.088638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1103/2160] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:46.101262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1058/2161] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:46.111655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:46.111776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:46.117113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:46.123484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463453-0b03-4973-b0d4-a12b8d812e31 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:46.130705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b249-5252-426f-a94f-f82ee4cfb5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:46.132019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b249-5252-426f-a94f-f82ee4cfb5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.132504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b249-5252-426f-a94f-f82ee4cfb5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.133472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b249-5252-426f-a94f-f82ee4cfb5c2 admin admin] PATH_INFO: `/v3/projects/a91d3226406e4f889c7f3abcd37ec490/users/1227fcf8876a4a0d839c4d9c10626c6e/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.156585 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1b249-5252-426f-a94f-f82ee4cfb5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91d3226406e4f889c7f3abcd37ec490, user_id=1227fcf8876a4a0d839c4d9c10626c6e, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:46.159878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1b249-5252-426f-a94f-f82ee4cfb5c2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:46.181232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1059/2162] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:46 2022] PUT /identity/v3/projects/a91d3226406e4f889c7f3abcd37ec490/users/1227fcf8876a4a0d839c4d9c10626c6e/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:46.187833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.188121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.188514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.209606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ba819-afe6-4951-9546-0c663a74d37d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:46.215101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:46.217140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:46.288967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:46.290254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.290254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.290254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.310882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1060/2163] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:46.311948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:46.313606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:46.353651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:46.409731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:46.411233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:46.417305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0eb7f-f55d-4ce2-9059-ddd81f77cbd7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:46.422158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebf5e2-d519-4c76-8064-93032638dc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:46.423103 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf5e2-d519-4c76-8064-93032638dc78 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.423220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1104/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:46.423302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf5e2-d519-4c76-8064-93032638dc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.423402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf5e2-d519-4c76-8064-93032638dc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.435569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf5e2-d519-4c76-8064-93032638dc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:46.437119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf5e2-d519-4c76-8064-93032638dc78 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:46.449795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1061/2165] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:46.710715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:46.721319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d49798-4acc-4ee1-93f5-02151ece3ac2 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:46.726526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:46.727201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.727513 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.727896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] PATH_INFO: `/v3/users/c7c1edcce89f41658210ce4992ddf2d6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.729032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c1edcce89f41658210ce4992ddf2d6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:46.732671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:46.793896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c1edcce89f41658210ce4992ddf2d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:46.803032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c1edcce89f41658210ce4992ddf2d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:46.811491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c1edcce89f41658210ce4992ddf2d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:46.824187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c1edcce89f41658210ce4992ddf2d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:46.825354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c1edcce89f41658210ce4992ddf2d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:46.834400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1105/2166] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:46 2022] DELETE /identity/v3/users/c7c1edcce89f41658210ce4992ddf2d6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:46.840285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:46.840603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:46.840897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:46.862870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:46.864092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:46.925238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1062/2167] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:46.935621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:46.937283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:46.996024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1259e39-f035-4ae6-ad58-3a905d381c95 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:46.999645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:47.000248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:47.000530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:47.000803 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:47.010055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:47.011600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:47.021714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1106/2168] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:51:47.343153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:47.344661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:47.362457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac2f0-3928-450a-b931-27195d291f86 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:47.375267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:47.376150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:47.377183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:47.377709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] PATH_INFO: `/v3/projects/3c072c4c95874de8b27a64df7fb20566` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:47.379136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c072c4c95874de8b27a64df7fb20566)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:47.381063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:47.399685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:47.441311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c072c4c95874de8b27a64df7fb20566', 'request_id': 'req-32e4b1fe-59f9-421c-b96d-271d7f51c94c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.451707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c072c4c95874de8b27a64df7fb20566', 'request_id': 'req-32e4b1fe-59f9-421c-b96d-271d7f51c94c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.472015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c072c4c95874de8b27a64df7fb20566', 'request_id': 'req-32e4b1fe-59f9-421c-b96d-271d7f51c94c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.487548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] The token cache is being invalidate because project 3c072c4c95874de8b27a64df7fb20566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:47.487897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.488611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.490637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1063/2169] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:47 2022] DELETE /identity/v3/projects/3c072c4c95874de8b27a64df7fb20566 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:47.494367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:47.505859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1466b-dab8-4a4a-9cfd-7bbd91d81932 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:47.564368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:47.623915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:47.628910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:47.629528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:47.630343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] PATH_INFO: `/v3/users/9deec1b492e24833bb330c12019f8307` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:47.632484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9deec1b492e24833bb330c12019f8307)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:47.636196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:47.705280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9deec1b492e24833bb330c12019f8307'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.730060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9deec1b492e24833bb330c12019f8307'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.740881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9deec1b492e24833bb330c12019f8307'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.757876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9deec1b492e24833bb330c12019f8307'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.759504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1cd10b05-1d80-4df9-8bf9-3ec7d618b3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9deec1b492e24833bb330c12019f8307'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:47.770001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1107/2170] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:47 2022] DELETE /identity/v3/users/9deec1b492e24833bb330c12019f8307 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:48.658864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:48.660512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:48.708495 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b1fe-59f9-421c-b96d-271d7f51c94c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:48.809713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:48.810382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:48.810821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:48.811099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] PATH_INFO: `/v3/projects/afbd7e0c319c4213bd584b3a047c9cc0` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:48.812224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbd7e0c319c4213bd584b3a047c9cc0)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:48.814286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:48.907160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbd7e0c319c4213bd584b3a047c9cc0', 'request_id': 'req-3e407042-2db2-444d-a4cf-d6c0abb0968a'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:48.914199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbd7e0c319c4213bd584b3a047c9cc0', 'request_id': 'req-3e407042-2db2-444d-a4cf-d6c0abb0968a'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:48.924052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbd7e0c319c4213bd584b3a047c9cc0', 'request_id': 'req-3e407042-2db2-444d-a4cf-d6c0abb0968a'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:48.942624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] The token cache is being invalidate because project afbd7e0c319c4213bd584b3a047c9cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:48.942938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:48.943665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3e407042-2db2-444d-a4cf-d6c0abb0968a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:48.945212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1064/2171] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:48 2022] DELETE /identity/v3/projects/afbd7e0c319c4213bd584b3a047c9cc0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:48.950221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:48.950710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:48.953469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:48.976204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:48.977422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:49.075692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1108/2172] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:49.077605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.078033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.078206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.099188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:49.100399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:49.109917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1065/2173] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:49.113552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.123680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33492d40-6a02-4de2-b1f3-66befcca0dc1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.128536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.129141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.129419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.129687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.130333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:49.130653 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.132548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.148353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1109/2174] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:51:49.153253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.166202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d65d-01a1-4139-a64f-1238e15f4907 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.172874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.173505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.173784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.174057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.175170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.177185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.224285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1066/2175] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:49 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:49.231244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.242095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2f46-aae2-47bc-87c8-68eaab15b97e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.326673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:49.335475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.336218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.336749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.337033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.339222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.344242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.383440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.383964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1110/2176] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:49 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:49.390317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:49.395598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7485b2-cc1b-4f8b-b09a-9d76c4319a2c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.404544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.405742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.406549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.407811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.408731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.410436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.426866 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1067/2177] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:49.428613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.442965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7dbd-e71d-4b06-8238-798647d6b9e1 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.450838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5356bbe-0030-4cee-8954-182f45d6d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.452017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356bbe-0030-4cee-8954-182f45d6d1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.452849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356bbe-0030-4cee-8954-182f45d6d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.453139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356bbe-0030-4cee-8954-182f45d6d1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.454148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356bbe-0030-4cee-8954-182f45d6d1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.455980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356bbe-0030-4cee-8954-182f45d6d1f5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.474355 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1111/2178] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:49.474975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.487921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27704e8-3db0-45ed-900c-59940784e437 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.493699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.494834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.495672 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.496452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] PATH_INFO: `/v3/projects/a6b4f7cf99274cc1b5f49a2e208ddc58/users/e7a6e8085daf4360b59726f81d405247/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.532362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b4f7cf99274cc1b5f49a2e208ddc58, user_id=e7a6e8085daf4360b59726f81d405247, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.535619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.559073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1068/2179] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:49 2022] PUT /identity/v3/projects/a6b4f7cf99274cc1b5f49a2e208ddc58/users/e7a6e8085daf4360b59726f81d405247/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:49.569358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.569610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.569869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.623586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] MFA Rules not processed for user `e7a6e8085daf4360b59726f81d405247`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:49.625009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:49.703587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1112/2180] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:49.708469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.849587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3a63-a277-4b20-bc51-b975b36f5a50 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:49.858812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:49.860092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:49.860726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:49.861367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:49.862046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:49.864022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:49.898692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1069/2181] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:49 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:49.901156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:49.913573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db1a6-8107-4cba-bd2e-bfb6bc73c846 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.017859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.018494 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.018777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.019054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.019680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.021583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.051175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1113/2182] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:49 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:50.054534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:50.071860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc8e6-1a25-4e96-9ce2-478b1881ad14 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.101691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.102632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.103393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.103820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.104635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.106442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.130524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1070/2183] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:50.134878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:50.149156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b677f-5958-407b-9904-452e70ca91bc admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.157130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.157728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.158013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.158294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] PATH_INFO: `/v3/projects/a6f822acf5f24471b68d4fc9de0ddd13/users/87115f755f5b43dfa04534056439a2e1/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.194464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f822acf5f24471b68d4fc9de0ddd13, user_id=87115f755f5b43dfa04534056439a2e1, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.199922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.223866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1114/2184] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:50 2022] PUT /identity/v3/projects/a6f822acf5f24471b68d4fc9de0ddd13/users/87115f755f5b43dfa04534056439a2e1/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:50.227409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:50.240671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cb87f-8d64-4c6c-92c8-a087bc0f836e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.316680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b4ca-65fc-4254-9fb3-c88f31db60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.317426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b4ca-65fc-4254-9fb3-c88f31db60b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.317714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b4ca-65fc-4254-9fb3-c88f31db60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.317985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b4ca-65fc-4254-9fb3-c88f31db60b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.318816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903b4ca-65fc-4254-9fb3-c88f31db60b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.320644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903b4ca-65fc-4254-9fb3-c88f31db60b0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.332897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1071/2185] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:50.339434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:50.353979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38251127-7fff-4f80-a357-6698d8ddfbdf admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.362054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.363066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.363446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.363871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] PATH_INFO: `/v3/projects/a6f822acf5f24471b68d4fc9de0ddd13/users/87115f755f5b43dfa04534056439a2e1/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.366226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f822acf5f24471b68d4fc9de0ddd13, user_id=87115f755f5b43dfa04534056439a2e1, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.370728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.387204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1115/2186] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:50 2022] PUT /identity/v3/projects/a6f822acf5f24471b68d4fc9de0ddd13/users/87115f755f5b43dfa04534056439a2e1/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:50.400616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.401154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.401527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.443070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] MFA Rules not processed for user `87115f755f5b43dfa04534056439a2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:50.444634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:50.490142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:50.567088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1072/2187] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:50.579560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:50.581857 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:50.597105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:50.725427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333109-8940-4960-922c-3c1482896000 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.731286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749efd8b-046f-4d3b-bdd4-6a82e3cb2b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.733420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efd8b-046f-4d3b-bdd4-6a82e3cb2b93 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.734060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efd8b-046f-4d3b-bdd4-6a82e3cb2b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.734703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efd8b-046f-4d3b-bdd4-6a82e3cb2b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.748146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749efd8b-046f-4d3b-bdd4-6a82e3cb2b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.750306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749efd8b-046f-4d3b-bdd4-6a82e3cb2b93 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.773307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1116/2188] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:50.871959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:50.874554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:50.896181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458d2a-c107-47b9-996a-61c4185b2f73 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:50.900768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:50.901395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:50.901735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:50.902575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:50.979272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:50.981627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:50.995717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1073/2189] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:51.696873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:51.697362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:51.697460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:51.738775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] MFA Rules not processed for user `1227fcf8876a4a0d839c4d9c10626c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:51.740001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:51.831022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1117/2190] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:51.835649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:51.837172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:51.930923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2910c-4493-4f46-b6af-e8ed15e676a6 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:51.942953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:51.943710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:51.944002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:51.944288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:51.944972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:51.946917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:51.990466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1074/2191] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:51 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:51.994677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:52.007025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16446-d19c-48f9-ad72-1eb341af2e8e None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:52.072525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:52.073227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:52.073598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:52.073908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:52.074559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:52.076952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:52.100629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1118/2192] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:51 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:52.104561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:52.116465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef407-b8a0-4e0b-aa1b-3c70dd423741 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:52.122096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:52.123061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:52.123343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:52.123614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:52.124265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:52.125860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:52.141692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1075/2193] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:52.142587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:52.153884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0d123-b20e-4b33-89d6-745eecd41fda admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:52.160703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:52.161382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:52.161683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:52.161952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] PATH_INFO: `/v3/projects/addea9bdac84411dafc8a419fc328dc4/users/2ef06e70cf1f4fe28a5cc95aee7325f3/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:52.179301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=addea9bdac84411dafc8a419fc328dc4, user_id=2ef06e70cf1f4fe28a5cc95aee7325f3, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:52.182260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:52.196150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1119/2194] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:52 2022] PUT /identity/v3/projects/addea9bdac84411dafc8a419fc328dc4/users/2ef06e70cf1f4fe28a5cc95aee7325f3/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:51:52.200099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:52.210601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c63f0-a51c-430c-be10-19a5192ff281 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:52.246283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:52.274399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:52.275049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:52.275334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:52.275606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:52.276284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:52.278407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:52.291637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1076/2195] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:52.293477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:52.300378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:52.304302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14b912-3fe8-4867-b601-51f83caed7ff admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:52.313463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feefd3-e869-48b9-87e3-b90ece84779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:52.314474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feefd3-e869-48b9-87e3-b90ece84779b admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:52.314787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feefd3-e869-48b9-87e3-b90ece84779b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:52.315072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feefd3-e869-48b9-87e3-b90ece84779b admin admin] PATH_INFO: `/v3/projects/addea9bdac84411dafc8a419fc328dc4/users/2ef06e70cf1f4fe28a5cc95aee7325f3/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:52.317280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feefd3-e869-48b9-87e3-b90ece84779b admin admin] RBAC: Authorizing `identity:create_grant(project_id=addea9bdac84411dafc8a419fc328dc4, user_id=2ef06e70cf1f4fe28a5cc95aee7325f3, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:52.319963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feefd3-e869-48b9-87e3-b90ece84779b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:52.348211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1120/2196] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:52 2022] PUT /identity/v3/projects/addea9bdac84411dafc8a419fc328dc4/users/2ef06e70cf1f4fe28a5cc95aee7325f3/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:54.128921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:54.130936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:54.177296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfa8a-aa66-4e19-b4b5-5a15450225b1 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:54.319156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:54.319830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:54.320121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:54.320721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] PATH_INFO: `/v3/users/28e52b26eb384784b0ed6e93d8b1c608` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:54.324892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e52b26eb384784b0ed6e93d8b1c608)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:54.328169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:54.457669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e52b26eb384784b0ed6e93d8b1c608'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:54.489456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e52b26eb384784b0ed6e93d8b1c608'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:54.508670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e52b26eb384784b0ed6e93d8b1c608'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:54.522905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e52b26eb384784b0ed6e93d8b1c608'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:54.524227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e52b26eb384784b0ed6e93d8b1c608'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:54.535257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1077/2197] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:54 2022] DELETE /identity/v3/users/28e52b26eb384784b0ed6e93d8b1c608 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:54.536608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:54.537071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:54.537146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:54.578013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:54.582716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:54.788519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1121/2198] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:54.797089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:54.799014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:54.922044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35671459-c28a-4218-bd8e-7c95a07b6b11 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:54.930802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:54.931497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:54.932100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:54.932434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:54.954917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:54.957282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:54.959101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:54.979936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1078/2199] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:51:55.461019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:55.462897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:55.491404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066573c-8c1b-4213-a42d-947da774f4b6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:55.510430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:55.512082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:55.514062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:55.514559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] PATH_INFO: `/v3/users/e7a6e8085daf4360b59726f81d405247` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:55.517395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a6e8085daf4360b59726f81d405247)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:55.524396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:55.620160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:55.626144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:55.642573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43968b7-1f38-4727-b6de-0e6fa4612f83 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:55.648104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:55.649217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:55.649663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:55.650246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] PATH_INFO: `/v3/projects/27e2b3cedbb541c5829705d86efc15a9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:55.652001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e2b3cedbb541c5829705d86efc15a9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:55.654241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:55.662504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a6e8085daf4360b59726f81d405247'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.678066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a6e8085daf4360b59726f81d405247'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.693394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a6e8085daf4360b59726f81d405247'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.715538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a6e8085daf4360b59726f81d405247'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.717420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3668b68f-8424-42f9-9465-82c8304ee340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a6e8085daf4360b59726f81d405247'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.731554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1122/2200] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:55 2022] DELETE /identity/v3/users/e7a6e8085daf4360b59726f81d405247 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:55.733689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:55.734508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:55.734692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:55.763213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:55.764643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:55.772826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e2b3cedbb541c5829705d86efc15a9', 'request_id': 'req-33dab571-30ac-489e-91db-e15c382e0183'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.798456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e2b3cedbb541c5829705d86efc15a9', 'request_id': 'req-33dab571-30ac-489e-91db-e15c382e0183'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.823819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e2b3cedbb541c5829705d86efc15a9', 'request_id': 'req-33dab571-30ac-489e-91db-e15c382e0183'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.837243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] The token cache is being invalidate because project 27e2b3cedbb541c5829705d86efc15a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:55.837984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.838877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:55.841833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1079/2201] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:55 2022] DELETE /identity/v3/projects/27e2b3cedbb541c5829705d86efc15a9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:55.909229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1123/2202] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:55.935441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:55.943212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:56.099853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab571-30ac-489e-91db-e15c382e0183 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:56.104523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:56.105415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:56.105905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:56.106343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:56.116884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:56.118540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:56.129748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1080/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:56.803694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:56.805517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:56.817030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:56.826385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20af49-682e-43b9-9b19-295f6c13ff8b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:56.854645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:56.858423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:56.859232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:56.859846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] PATH_INFO: `/v3/projects/a6b4f7cf99274cc1b5f49a2e208ddc58` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:56.862773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b4f7cf99274cc1b5f49a2e208ddc58)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:56.871000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:56.973397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b4f7cf99274cc1b5f49a2e208ddc58', 'request_id': 'req-7044435e-9f34-45ed-9ce0-0e8891c6dda0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:56.983468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b4f7cf99274cc1b5f49a2e208ddc58', 'request_id': 'req-7044435e-9f34-45ed-9ce0-0e8891c6dda0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.004037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b4f7cf99274cc1b5f49a2e208ddc58', 'request_id': 'req-7044435e-9f34-45ed-9ce0-0e8891c6dda0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.018057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] The token cache is being invalidate because project a6b4f7cf99274cc1b5f49a2e208ddc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:57.018733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.019700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.022281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1124/2204] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:56 2022] DELETE /identity/v3/projects/a6b4f7cf99274cc1b5f49a2e208ddc58 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:57.026237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:57.039875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffa76b-6fdc-446c-b498-12c45528dcd1 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:57.165370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:57.166986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:57.168139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:57.168807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] PATH_INFO: `/v3/users/87115f755f5b43dfa04534056439a2e1` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:57.175319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87115f755f5b43dfa04534056439a2e1)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:57.178478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:57.231955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:57.276603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87115f755f5b43dfa04534056439a2e1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.286166 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87115f755f5b43dfa04534056439a2e1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.328094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87115f755f5b43dfa04534056439a2e1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.340992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87115f755f5b43dfa04534056439a2e1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.341733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a78b4a35-cebb-49ec-80c4-e1d9451ce7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87115f755f5b43dfa04534056439a2e1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.353230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1081/2205] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:51:57 2022] DELETE /identity/v3/users/87115f755f5b43dfa04534056439a2e1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:57.773873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:57.775519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:57.797477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044435e-9f34-45ed-9ce0-0e8891c6dda0 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:57.879481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:57.880541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:57.881229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:57.881229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] PATH_INFO: `/v3/projects/a6f822acf5f24471b68d4fc9de0ddd13` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:57.882536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f822acf5f24471b68d4fc9de0ddd13)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:57.884927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:57.959701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f822acf5f24471b68d4fc9de0ddd13', 'request_id': 'req-6435fcef-237c-4362-b825-35b4edffb89a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.970963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f822acf5f24471b68d4fc9de0ddd13', 'request_id': 'req-6435fcef-237c-4362-b825-35b4edffb89a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:57.981959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f822acf5f24471b68d4fc9de0ddd13', 'request_id': 'req-6435fcef-237c-4362-b825-35b4edffb89a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:58.000007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] The token cache is being invalidate because project a6f822acf5f24471b68d4fc9de0ddd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:51:58.000007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:58.001006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6435fcef-237c-4362-b825-35b4edffb89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:51:58.005875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1125/2206] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:51:57 2022] DELETE /identity/v3/projects/a6f822acf5f24471b68d4fc9de0ddd13 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:58.007649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.008737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.008737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.032135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:58.033663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:58.127629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1082/2207] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:58.135932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e1671-079d-4888-ad34-03c73034f731 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.136285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e1671-079d-4888-ad34-03c73034f731 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.136565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e1671-079d-4888-ad34-03c73034f731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.159315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-329e1671-079d-4888-ad34-03c73034f731 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:58.160514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-329e1671-079d-4888-ad34-03c73034f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:58.173604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1126/2208] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:58.174825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.189819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ff59-3b25-4d6b-a242-f6cfa81d670c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.194995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.195605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.195897 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.196171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.196827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:51:58.197135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.198848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.214763 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1083/2209] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:51:58.217075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e1671-079d-4888-ad34-03c73034f731 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.233569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e1671-079d-4888-ad34-03c73034f731 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.238589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.239336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.239987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.240278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.241086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.243410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.255265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:58.283324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1127/2210] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:58.287662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.315129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a33b8c-74bb-4e31-9858-8d76861711f4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.394395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.395438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.395438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.395666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.396296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.398230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.435983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1084/2211] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:58.437556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.451174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f94ea-39b0-48b4-9a2a-51e952c26c77 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.460546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.462051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.463535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.464066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.465019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.467600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.479620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1128/2212] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:58.484211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.501501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86418-0cd3-4b97-8dd7-f190458b316d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.507523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b5edd-ce81-456c-9a74-0c341d9e477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.509518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5edd-ce81-456c-9a74-0c341d9e477e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.509813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5edd-ce81-456c-9a74-0c341d9e477e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.510096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5edd-ce81-456c-9a74-0c341d9e477e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.510796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b5edd-ce81-456c-9a74-0c341d9e477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.514097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b5edd-ce81-456c-9a74-0c341d9e477e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.531190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1085/2213] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:58.532700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.549787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b923-d436-4d32-8f28-bc4466945758 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.561462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5884ef-724f-44ef-8840-f45192616a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.563141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5884ef-724f-44ef-8840-f45192616a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.563813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5884ef-724f-44ef-8840-f45192616a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.564353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5884ef-724f-44ef-8840-f45192616a58 admin admin] PATH_INFO: `/v3/projects/81d91050016141f591c41d530a675725/users/98cf6beba7fd449598cd23bdae818c8c/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.588296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5884ef-724f-44ef-8840-f45192616a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d91050016141f591c41d530a675725, user_id=98cf6beba7fd449598cd23bdae818c8c, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.592482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5884ef-724f-44ef-8840-f45192616a58 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.627629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1129/2214] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:58 2022] PUT /identity/v3/projects/81d91050016141f591c41d530a675725/users/98cf6beba7fd449598cd23bdae818c8c/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:58.629161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.629461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.629736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.644350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:58.668104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] MFA Rules not processed for user `98cf6beba7fd449598cd23bdae818c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:58.669435 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:58.711603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530061-c426-4684-809f-c879a68811a6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.712037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530061-c426-4684-809f-c879a68811a6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.712387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530061-c426-4684-809f-c879a68811a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.755175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-03530061-c426-4684-809f-c879a68811a6 None None] MFA Rules not processed for user `2ef06e70cf1f4fe28a5cc95aee7325f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:58.757363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-03530061-c426-4684-809f-c879a68811a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:58.763561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1086/2215] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:58.767714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.852582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5730eb8-a5c3-4210-9dea-637ed6ac4ef5 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:58.863416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1130/2216] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:58.868415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:58.869545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:58.869827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:58.870109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:58.871344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:58.873684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:58.878572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530061-c426-4684-809f-c879a68811a6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.879969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-03530061-c426-4684-809f-c879a68811a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:58.906555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1087/2217] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:51:58.910445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:58.969447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530061-c426-4684-809f-c879a68811a6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.008389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916819-6a8e-49ce-9ecc-e7816806daa2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.015234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.015851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.016128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.016409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.017031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.018987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.040033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.040713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.040997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.041273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.042392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1088/2218] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:51:58 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:51:59.043833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:59.046498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.059994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a707-a8aa-461b-b757-b7d58b283440 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.061089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:59.065657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.066384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.067593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.067593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.068310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.070126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.079068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:59.089937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1089/2219] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:51:59.091418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.102496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4eda6-f38f-42f2-9a6e-ad7b89a54f77 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.108095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.108839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.109331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.109726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] PATH_INFO: `/v3/projects/27fd6464ce4e40e7ad07c6ffe66bf584/users/cc5dd4217eb44f9b92534348dfec406d/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.125707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.127226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fd6464ce4e40e7ad07c6ffe66bf584, user_id=cc5dd4217eb44f9b92534348dfec406d, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.127379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.130417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.138112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1131/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:51:59.147349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1090/2221] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:59 2022] PUT /identity/v3/projects/27fd6464ce4e40e7ad07c6ffe66bf584/users/cc5dd4217eb44f9b92534348dfec406d/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:59.151296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.164847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b9d56-de31-48dc-b6ba-3bf707b001da service glance] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.242539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c6ac-6bb5-491d-ae65-173a0176ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.243818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c6ac-6bb5-491d-ae65-173a0176ce27 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.244302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c6ac-6bb5-491d-ae65-173a0176ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.244799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c6ac-6bb5-491d-ae65-173a0176ce27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.246375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c6ac-6bb5-491d-ae65-173a0176ce27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.248802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c6ac-6bb5-491d-ae65-173a0176ce27 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.269233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1132/2222] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:51:59.272214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.300535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c5943-b17c-4c06-8e81-55f0db411377 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.307449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a755501-1573-4801-8cae-3044235738c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.309908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a755501-1573-4801-8cae-3044235738c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.310378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a755501-1573-4801-8cae-3044235738c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.313220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a755501-1573-4801-8cae-3044235738c4 admin admin] PATH_INFO: `/v3/projects/27fd6464ce4e40e7ad07c6ffe66bf584/users/cc5dd4217eb44f9b92534348dfec406d/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.315436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a755501-1573-4801-8cae-3044235738c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fd6464ce4e40e7ad07c6ffe66bf584, user_id=cc5dd4217eb44f9b92534348dfec406d, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.318396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.319238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.319238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.319427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a755501-1573-4801-8cae-3044235738c4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.334012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1091/2223] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:51:59 2022] PUT /identity/v3/projects/27fd6464ce4e40e7ad07c6ffe66bf584/users/cc5dd4217eb44f9b92534348dfec406d/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:51:59.345863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.346531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.347410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.348442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:59.349859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:59.385774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] MFA Rules not processed for user `cc5dd4217eb44f9b92534348dfec406d`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:51:59.387224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:59.457078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1133/2224] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:51:59.484231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.486222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:59.531729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1092/2225] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:51:59.543295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.544661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:59.573560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:51:59.596070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d8fdf-058b-4050-830d-2a9ce364d319 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.603552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.604181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.604482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.604750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.615610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.617329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.627864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1134/2226] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:51:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 11:51:59.645543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fa3ca-78c1-451d-bb70-50126e885ab7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.649678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.650296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.650581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.651189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.671588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.676445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.688828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1093/2227] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:51:59.749029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:51:59.750625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:51:59.765872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78b86-ac8d-4acb-aacb-ee411ab018b0 service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:51:59.771269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6fa7f-c0c8-428e-93fd-bb5defd6f9c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:51:59.772019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6fa7f-c0c8-428e-93fd-bb5defd6f9c3 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:51:59.772407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6fa7f-c0c8-428e-93fd-bb5defd6f9c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:51:59.772785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6fa7f-c0c8-428e-93fd-bb5defd6f9c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:51:59.880974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6fa7f-c0c8-428e-93fd-bb5defd6f9c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:51:59.898426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6fa7f-c0c8-428e-93fd-bb5defd6f9c3 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:51:59.914660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1135/2228] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:04.343223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:04.471699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:04.491718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e5d8-edfb-42ae-a5b7-2aa0043f916f service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:04.512412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:04.513182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:04.513463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:04.513767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] PATH_INFO: `/v3/users/98cf6beba7fd449598cd23bdae818c8c` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:04.515098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98cf6beba7fd449598cd23bdae818c8c)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:04.520294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:04.605108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98cf6beba7fd449598cd23bdae818c8c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:04.625170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98cf6beba7fd449598cd23bdae818c8c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:04.646130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98cf6beba7fd449598cd23bdae818c8c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:04.660594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98cf6beba7fd449598cd23bdae818c8c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:04.661781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98cf6beba7fd449598cd23bdae818c8c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:04.671551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1094/2229] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:52:04 2022] DELETE /identity/v3/users/98cf6beba7fd449598cd23bdae818c8c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:04.676830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:04.677788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:04.678066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:04.708105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:04.709335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:04.779144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1136/2230] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:04.795029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:04.797849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:04.879631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f20f5-6837-4b72-8a3c-7e0d977119a7 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:04.883991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:04.884892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:04.885191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:04.885471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:04.898709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:04.900311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:04.916206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1095/2231] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:05.306997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:05.306997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:05.354020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a415d-d8a3-4717-92d1-06d6fdea9ca3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:05.372029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:05.372853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:05.373224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:05.373598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] PATH_INFO: `/v3/projects/81d91050016141f591c41d530a675725` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:05.374885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d91050016141f591c41d530a675725)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:05.376893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:05.472570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d91050016141f591c41d530a675725', 'request_id': 'req-47042349-44da-4784-8fe6-a26e6a14cbf4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.483031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d91050016141f591c41d530a675725', 'request_id': 'req-47042349-44da-4784-8fe6-a26e6a14cbf4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.506598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d91050016141f591c41d530a675725', 'request_id': 'req-47042349-44da-4784-8fe6-a26e6a14cbf4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.536631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] The token cache is being invalidate because project 81d91050016141f591c41d530a675725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:52:05.537205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.538396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-47042349-44da-4784-8fe6-a26e6a14cbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.540327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1137/2232] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:52:05 2022] DELETE /identity/v3/projects/81d91050016141f591c41d530a675725 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:05.545973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:05.562978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34822e70-6b08-4b30-9865-7c008bf7b65b service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:05.688152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:05.689189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:05.689626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:05.690081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] PATH_INFO: `/v3/users/cc5dd4217eb44f9b92534348dfec406d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:05.691443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5dd4217eb44f9b92534348dfec406d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:05.693705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:05.708240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:05.754827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5dd4217eb44f9b92534348dfec406d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.771522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5dd4217eb44f9b92534348dfec406d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.791970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5dd4217eb44f9b92534348dfec406d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.801249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5dd4217eb44f9b92534348dfec406d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.802402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5dd4217eb44f9b92534348dfec406d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:05.812755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1096/2233] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:52:05 2022] DELETE /identity/v3/users/cc5dd4217eb44f9b92534348dfec406d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:06.006712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4260a-364c-4d03-9f04-da4766a5c583 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.007203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4260a-364c-4d03-9f04-da4766a5c583 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.007303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4260a-364c-4d03-9f04-da4766a5c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.015278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:06.030718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-60a4260a-364c-4d03-9f04-da4766a5c583 None None] MFA Rules not processed for user `72a30400dec14a85889af8d8dd59886e`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:06.031970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-60a4260a-364c-4d03-9f04-da4766a5c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:06.107183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1138/2234] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:06.172592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:06.174952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:06.277142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51874f-64f8-4d68-bd15-1c509624bed8 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:06.283013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:06.284779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.285137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.285497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] PATH_INFO: `/v3/projects/27fd6464ce4e40e7ad07c6ffe66bf584` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.286808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fd6464ce4e40e7ad07c6ffe66bf584)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:06.289250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:06.400011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fd6464ce4e40e7ad07c6ffe66bf584', 'request_id': 'req-82c38d32-3886-421e-8619-c931d711b14b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:06.409168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fd6464ce4e40e7ad07c6ffe66bf584', 'request_id': 'req-82c38d32-3886-421e-8619-c931d711b14b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:06.421161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fd6464ce4e40e7ad07c6ffe66bf584', 'request_id': 'req-82c38d32-3886-421e-8619-c931d711b14b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:06.434104 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] The token cache is being invalidate because project 27fd6464ce4e40e7ad07c6ffe66bf584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:52:06.434487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:06.435243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-82c38d32-3886-421e-8619-c931d711b14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:06.436998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1097/2235] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:52:06 2022] DELETE /identity/v3/projects/27fd6464ce4e40e7ad07c6ffe66bf584 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:06.441957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.442322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.442691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.466340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:06.467667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:06.582538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1139/2236] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:06.583684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.584163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.584269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.620239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:06.621519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:06.640081 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:06.645992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1098/2237] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:52:06.656477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d52142-162b-4ce7-ab82-3829a1bf9d8a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:06.664066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:06.664832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.665179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.665850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.666661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:52:06.667119 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:06.669486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:06.706909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:06.709413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1140/2238] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:52:06.713473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fba86-6c1d-4583-94d5-c89060fe7cd8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:06.728467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:06.729252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.729638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.730059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.730841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:06.733207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:06.760918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:06.783442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1099/2239] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:52:06 2022] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:52:06.787587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:06.801713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6cbc-45b7-4c4a-bd82-808df328c5b4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:06.880521 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:06.881809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.881809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.881809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.882319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:06.884285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:06.918334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1141/2240] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:52:06 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:52:06.919222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:06.945747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dce91-b223-42e7-81f7-ea8b26484440 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:06.964173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:06.965653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:06.966010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:06.966399 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:06.967154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:06.969371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:06.980452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1100/2241] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:06.984691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:06.999108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d07d4-8ccb-402b-be00-341f8c2bbe14 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.004280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0ff65-4733-4a35-b344-be0924e4ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.005183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0ff65-4733-4a35-b344-be0924e4ec86 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.005466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0ff65-4733-4a35-b344-be0924e4ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.005738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0ff65-4733-4a35-b344-be0924e4ec86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.006394 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0ff65-4733-4a35-b344-be0924e4ec86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.008162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0ff65-4733-4a35-b344-be0924e4ec86 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.025641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1142/2242] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:07.030091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.040733 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add18fcc-2abd-45a7-90da-10251bc2fbd2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.047295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.049351 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.049758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.050619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] PATH_INFO: `/v3/projects/22321498a6004e7db89eac9094299aee/users/5bfb923f736444febc30409623713bfa/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.071931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22321498a6004e7db89eac9094299aee, user_id=5bfb923f736444febc30409623713bfa, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.075612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.109066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1101/2243] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:52:07 2022] PUT /identity/v3/projects/22321498a6004e7db89eac9094299aee/users/5bfb923f736444febc30409623713bfa/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:07.110282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.111410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.111410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.155748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:07.159317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] MFA Rules not processed for user `5bfb923f736444febc30409623713bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:07.162113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:07.254422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1143/2244] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:07.259054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.339951 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21df8b-7385-4ce0-bbc7-79b0849b049d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.347439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.348151 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.348507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.348860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.349573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.351721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.397873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1102/2245] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:52:07 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:52:07.402559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.414250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb38191-8774-4e01-ae32-9f62d8c3bc1d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.480560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.481281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.481636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.481975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.482706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.484741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.521258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1144/2246] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:52:07 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:52:07.522531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.534063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0554d-e92e-4b4e-8bbb-608c7d89a9f6 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.541568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.542920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.543361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.543708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.544430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.546105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.566991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1103/2247] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:07.568217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.581754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2e79-7665-46fa-935d-5a6d7afc5271 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.587244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.588002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.588350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.588695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] PATH_INFO: `/v3/projects/b3b8d16335e64116b269655030b20334/users/3256c2cae6ee40a7b7c86cb890d0768e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.623554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b8d16335e64116b269655030b20334, user_id=3256c2cae6ee40a7b7c86cb890d0768e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.626842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.650048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1145/2248] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:52:07 2022] PUT /identity/v3/projects/b3b8d16335e64116b269655030b20334/users/3256c2cae6ee40a7b7c86cb890d0768e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:07.654869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.673481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839d49f-f7de-4f6f-9169-bbd2ac1d5a91 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.764845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed8934-fac2-408c-a942-cbb3486a8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.765670 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8934-fac2-408c-a942-cbb3486a8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.766099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8934-fac2-408c-a942-cbb3486a8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.766517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8934-fac2-408c-a942-cbb3486a8a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.767472 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed8934-fac2-408c-a942-cbb3486a8a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.769534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed8934-fac2-408c-a942-cbb3486a8a4d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.782101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1104/2249] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:52:07.789951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:07.801511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c97f-4d29-4264-9455-b3f7fa71bee0 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:07.809112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:07.810902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.812212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.812495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] PATH_INFO: `/v3/projects/b3b8d16335e64116b269655030b20334/users/3256c2cae6ee40a7b7c86cb890d0768e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.819090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b8d16335e64116b269655030b20334, user_id=3256c2cae6ee40a7b7c86cb890d0768e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:07.831773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:07.858270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1146/2250] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:52:07 2022] PUT /identity/v3/projects/b3b8d16335e64116b269655030b20334/users/3256c2cae6ee40a7b7c86cb890d0768e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:07.891920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:07.892210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:07.892489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:07.930801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] MFA Rules not processed for user `3256c2cae6ee40a7b7c86cb890d0768e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:07.932597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:07.962917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:08.069346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1105/2251] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:08.087467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:08.091699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:08.187764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7a7c-9fd8-41fb-9ce4-87dd75c78bcb admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:08.192589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b3d24-a68c-4b6b-9d3a-604664be0fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:08.193465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b3d24-a68c-4b6b-9d3a-604664be0fbc service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:08.193951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b3d24-a68c-4b6b-9d3a-604664be0fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:08.194290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b3d24-a68c-4b6b-9d3a-604664be0fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:08.213920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b3d24-a68c-4b6b-9d3a-604664be0fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:08.215533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b3d24-a68c-4b6b-9d3a-604664be0fbc service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:08.220593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:08.237826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1147/2252] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:08.390215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:08.463297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bf56c-fb46-4383-8560-b0c2acd9d8f7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:08.468331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:08.468987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:08.469260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:08.469535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] PATH_INFO: `/v3/users/5bfb923f736444febc30409623713bfa` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:08.470688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfb923f736444febc30409623713bfa)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:08.472833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:08.543368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfb923f736444febc30409623713bfa'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:08.557275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfb923f736444febc30409623713bfa'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:08.580209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfb923f736444febc30409623713bfa'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:08.587185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfb923f736444febc30409623713bfa'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:08.587921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfb923f736444febc30409623713bfa'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:08.610744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1106/2253] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:52:08 2022] DELETE /identity/v3/users/5bfb923f736444febc30409623713bfa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:08.614238 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:08.614829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:08.615247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:08.641862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:08.643502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:08.728964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1148/2254] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:08.739859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:08.742279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:08.785965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:08.823917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794548-6268-48bd-8a87-24cffbd1f51b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:08.849014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:08.849651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:08.849934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:08.850211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:08.887769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:08.889249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:08.904999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1107/2255] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:09.554316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:09.556388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:09.570265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36603c73-ebae-4994-b0b8-95912684dbb1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:09.575956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:09.576838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:09.577321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:09.577910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] PATH_INFO: `/v3/projects/22321498a6004e7db89eac9094299aee` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:09.579425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22321498a6004e7db89eac9094299aee)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:09.581549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:09.665568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22321498a6004e7db89eac9094299aee', 'request_id': 'req-7a388ce3-5064-4148-87e7-b952c6326ed4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.673624 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22321498a6004e7db89eac9094299aee', 'request_id': 'req-7a388ce3-5064-4148-87e7-b952c6326ed4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.685774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22321498a6004e7db89eac9094299aee', 'request_id': 'req-7a388ce3-5064-4148-87e7-b952c6326ed4'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.699172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] The token cache is being invalidate because project 22321498a6004e7db89eac9094299aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:52:09.699474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.700213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.701991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1149/2256] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:52:09 2022] DELETE /identity/v3/projects/22321498a6004e7db89eac9094299aee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:09.705891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:09.722543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2d66-a00b-4bcc-9816-492fa795f2e4 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:09.796709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:09.797386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:09.797825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:09.798311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] PATH_INFO: `/v3/users/3256c2cae6ee40a7b7c86cb890d0768e` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:09.799794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3256c2cae6ee40a7b7c86cb890d0768e)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:09.802058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:09.883631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3256c2cae6ee40a7b7c86cb890d0768e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.897528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3256c2cae6ee40a7b7c86cb890d0768e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.924169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3256c2cae6ee40a7b7c86cb890d0768e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.952644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3256c2cae6ee40a7b7c86cb890d0768e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.954112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a24f48a3-1482-4de2-bd4c-9753dd937c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3256c2cae6ee40a7b7c86cb890d0768e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:09.967208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1108/2257] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:52:09 2022] DELETE /identity/v3/users/3256c2cae6ee40a7b7c86cb890d0768e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:10.713978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:10.716564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:10.733609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388ce3-5064-4148-87e7-b952c6326ed4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:10.919210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:10.920123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:10.920540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:10.920823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] PATH_INFO: `/v3/projects/b3b8d16335e64116b269655030b20334` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:10.921975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b8d16335e64116b269655030b20334)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:10.924184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:10.952586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:11.021146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b8d16335e64116b269655030b20334', 'request_id': 'req-5cd485da-e357-4c32-8248-542fac037e94'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:11.033075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b8d16335e64116b269655030b20334', 'request_id': 'req-5cd485da-e357-4c32-8248-542fac037e94'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:11.069222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b8d16335e64116b269655030b20334', 'request_id': 'req-5cd485da-e357-4c32-8248-542fac037e94'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:11.084085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] The token cache is being invalidate because project b3b8d16335e64116b269655030b20334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:52:11.084450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:11.085894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-5cd485da-e357-4c32-8248-542fac037e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:11.091011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1150/2258] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:52:10 2022] DELETE /identity/v3/projects/b3b8d16335e64116b269655030b20334 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:11.094010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.094455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.094542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.122567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:11.124137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:11.188203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:11.207655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1109/2259] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:11.217281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.217650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.218745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.244668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:11.245947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:11.255303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1151/2260] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:11.264100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:11.291571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8dd15-f672-4c46-a48a-d8b01a9d2e01 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:11.296782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:11.297519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.297903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.298279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.299070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:52:11.299443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:11.301258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:11.319421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1110/2261] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:52:11.325156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:11.337364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77b79b-47c7-481c-855f-73ba3499b1e2 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:11.361089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:11.362026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.362539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.362983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.363897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:11.368083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:11.421542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1152/2262] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:52:11 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:52:11.425596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:11.437735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3f91-dc13-4b32-b784-342988e19b46 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:11.509456 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:11.509696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.509845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.510198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.510899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:11.513540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:11.552704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1111/2263] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:52:11 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:52:11.553993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:11.567283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6e9e-c690-40cd-aa4b-25eaa70ff0db admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:11.574998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:11.575804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.576165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.576512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.577374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:11.579158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:11.601904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1153/2264] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:11.603420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:11.616353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa1e2-afb0-47fe-9115-136863d26929 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:11.623764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472e30-102a-40ab-9f02-9a5f2c937d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:11.624771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472e30-102a-40ab-9f02-9a5f2c937d3e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.625199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472e30-102a-40ab-9f02-9a5f2c937d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.625599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472e30-102a-40ab-9f02-9a5f2c937d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.626312 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45472e30-102a-40ab-9f02-9a5f2c937d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:11.628220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45472e30-102a-40ab-9f02-9a5f2c937d3e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:11.646283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1112/2265] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:11.647681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:11.663811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157480b7-dd64-40ba-a402-c51569765e4d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:11.685977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:11.686955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.687421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.687864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] PATH_INFO: `/v3/projects/16df438cb8594c51bfc2441c0ecb5968/users/69ad3e9d0e0447d0835adbfe1f1b1b25/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.708464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16df438cb8594c51bfc2441c0ecb5968, user_id=69ad3e9d0e0447d0835adbfe1f1b1b25, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:11.711723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:11.735696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1154/2266] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:52:11 2022] PUT /identity/v3/projects/16df438cb8594c51bfc2441c0ecb5968/users/69ad3e9d0e0447d0835adbfe1f1b1b25/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:52:11.750109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:11.750644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:11.750983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:11.788243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] MFA Rules not processed for user `69ad3e9d0e0447d0835adbfe1f1b1b25`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:11.793941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:11.944966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1113/2267] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:52:11.950045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.053707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47852-81ed-47c3-a077-c57fc606f1b7 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.060856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.061524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.061877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.062141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.062893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.064819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.108308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1155/2268] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:52:11 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:52:12.109726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.130367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da254cc-8381-4cb0-a971-58a7db03e48f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.225648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:12.244028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.244922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.245338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.246210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.247012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.249249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.286770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1114/2269] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:52:12 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:52:12.288177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.300671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5ce2-c983-45c8-9a52-fd5ad132b533 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.305560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.306256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.306542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.307432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.308850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.310552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.326657 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1156/2270] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:12.330601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.344729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a105-457f-4739-9d57-9d7968dddace admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.349907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.351130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.351521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.352050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] PATH_INFO: `/v3/projects/157c41e015804b70a15ad5335f2da7d7/users/1051f922812940c5995a07a7f086eae6/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.374760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=157c41e015804b70a15ad5335f2da7d7, user_id=1051f922812940c5995a07a7f086eae6, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.377596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.398813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1115/2271] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:52:12 2022] PUT /identity/v3/projects/157c41e015804b70a15ad5335f2da7d7/users/1051f922812940c5995a07a7f086eae6/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:12.403745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.416001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395edc00-dd5d-4797-987c-16ce1f5a89ae admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.443128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:12.514028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f72ca-a857-44e1-a830-29be059cd5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.514849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f72ca-a857-44e1-a830-29be059cd5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.515975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f72ca-a857-44e1-a830-29be059cd5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.516699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f72ca-a857-44e1-a830-29be059cd5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.517454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f72ca-a857-44e1-a830-29be059cd5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.520760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f72ca-a857-44e1-a830-29be059cd5d9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.537164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1157/2272] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:52:12.541284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.554276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757f769-b153-4a10-b825-03d92cc940aa admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.559625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.560308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.560597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.560955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] PATH_INFO: `/v3/projects/157c41e015804b70a15ad5335f2da7d7/users/1051f922812940c5995a07a7f086eae6/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.563006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157c41e015804b70a15ad5335f2da7d7, user_id=1051f922812940c5995a07a7f086eae6, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.565695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.578138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1116/2273] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:52:12 2022] PUT /identity/v3/projects/157c41e015804b70a15ad5335f2da7d7/users/1051f922812940c5995a07a7f086eae6/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:12.589769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090e9e-5735-409f-a722-9afc1ca5c81a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.590166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090e9e-5735-409f-a722-9afc1ca5c81a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.590684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090e9e-5735-409f-a722-9afc1ca5c81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.637466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f5090e9e-5735-409f-a722-9afc1ca5c81a None None] MFA Rules not processed for user `1051f922812940c5995a07a7f086eae6`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:12.639009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f5090e9e-5735-409f-a722-9afc1ca5c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:12.773199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1158/2274] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:12.788817 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:12.790511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:12.857001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc9928-35b4-410e-8ecf-936caa520454 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:12.865280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:12.865905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.866188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.866465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:12.876931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:12.878230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:12.889549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1117/2275] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:12.992181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5749a5-8273-4ea6-bc6e-35edd4a1f602 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:12.992516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5749a5-8273-4ea6-bc6e-35edd4a1f602 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:12.992795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5749a5-8273-4ea6-bc6e-35edd4a1f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:13.015872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4b5749a5-8273-4ea6-bc6e-35edd4a1f602 None None] MFA Rules not processed for user `1227fcf8876a4a0d839c4d9c10626c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:13.017819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4b5749a5-8273-4ea6-bc6e-35edd4a1f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:13.093936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1159/2276] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:13.361948 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:13.431295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc4b8-3fec-4ca5-b707-ae51c253e77d service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:13.436768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:13.437526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:13.438356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:13.438356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] PATH_INFO: `/v3/users/69ad3e9d0e0447d0835adbfe1f1b1b25` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:13.439543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ad3e9d0e0447d0835adbfe1f1b1b25)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:13.441605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:13.498420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ad3e9d0e0447d0835adbfe1f1b1b25'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:13.500129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:13.507367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ad3e9d0e0447d0835adbfe1f1b1b25'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:13.520628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ad3e9d0e0447d0835adbfe1f1b1b25'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:13.528718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ad3e9d0e0447d0835adbfe1f1b1b25'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:13.529489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ad3e9d0e0447d0835adbfe1f1b1b25'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:13.535601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1118/2277] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:52:13 2022] DELETE /identity/v3/users/69ad3e9d0e0447d0835adbfe1f1b1b25 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:13.540090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:13.540376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:13.540655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:13.561068 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:13.562259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:13.607816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:13.625641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1160/2278] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:13.635622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:13.637092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:13.695837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa3372-0cda-471a-a2f4-7e9b105b04d1 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:13.699507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:13.700457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:13.700737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:13.701009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:13.711193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:13.712784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:13.726952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1119/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:14.421670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:14.423259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:14.435987 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43f42b-6938-4d82-bc10-1aca1bb91793 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:14.440977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:14.441483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:14.441968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:14.442247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] PATH_INFO: `/v3/projects/16df438cb8594c51bfc2441c0ecb5968` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:14.443414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16df438cb8594c51bfc2441c0ecb5968)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:14.445392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:14.515511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16df438cb8594c51bfc2441c0ecb5968', 'request_id': 'req-f11695ee-ca99-44dd-95db-78b988b67e4c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.522237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16df438cb8594c51bfc2441c0ecb5968', 'request_id': 'req-f11695ee-ca99-44dd-95db-78b988b67e4c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.532024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16df438cb8594c51bfc2441c0ecb5968', 'request_id': 'req-f11695ee-ca99-44dd-95db-78b988b67e4c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.543176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] The token cache is being invalidate because project 16df438cb8594c51bfc2441c0ecb5968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:52:14.543460 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.544097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.545595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1161/2280] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:52:14 2022] DELETE /identity/v3/projects/16df438cb8594c51bfc2441c0ecb5968 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:14.549637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:14.560531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abed9c4-1785-4b70-a38f-eefa8f5b6781 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:14.618391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:14.619059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:14.619340 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:14.619613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] PATH_INFO: `/v3/users/1051f922812940c5995a07a7f086eae6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:14.620766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1051f922812940c5995a07a7f086eae6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:14.622745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:14.671693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1051f922812940c5995a07a7f086eae6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.678884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1051f922812940c5995a07a7f086eae6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.689857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:14.691282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1051f922812940c5995a07a7f086eae6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.700146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1051f922812940c5995a07a7f086eae6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.700779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-062b1dec-11cb-4747-9980-4b1da597489c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1051f922812940c5995a07a7f086eae6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:14.706467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1120/2281] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:52:14 2022] DELETE /identity/v3/users/1051f922812940c5995a07a7f086eae6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:15.010570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:15.012647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:15.038310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11695ee-ca99-44dd-95db-78b988b67e4c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:15.096286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:15.096920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:15.097199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:15.097474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] PATH_INFO: `/v3/projects/157c41e015804b70a15ad5335f2da7d7` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:15.098600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=157c41e015804b70a15ad5335f2da7d7)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:15.100565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:15.147114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157c41e015804b70a15ad5335f2da7d7', 'request_id': 'req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:15.153878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157c41e015804b70a15ad5335f2da7d7', 'request_id': 'req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:15.161097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157c41e015804b70a15ad5335f2da7d7', 'request_id': 'req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:15.171251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] The token cache is being invalidate because project 157c41e015804b70a15ad5335f2da7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:52:15.171548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:15.172149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:52:15.173622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1162/2282] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:52:15 2022] DELETE /identity/v3/projects/157c41e015804b70a15ad5335f2da7d7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:52:16.404636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1c82-99a5-46d7-9e4f-b81a4e0eeff5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:16.405101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1c82-99a5-46d7-9e4f-b81a4e0eeff5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:16.405192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1c82-99a5-46d7-9e4f-b81a4e0eeff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:16.424520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f7bb1c82-99a5-46d7-9e4f-b81a4e0eeff5 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:16.425724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f7bb1c82-99a5-46d7-9e4f-b81a4e0eeff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:16.483143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1121/2283] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:16.495247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:16.496853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:16.502583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:16.575873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76361d6-4163-4bf5-8816-ee8d3d5d52ff admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:16.583445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:16.584672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:16.585013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:16.585373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:16.595208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:16.596796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:16.605981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1163/2284] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:52:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 11:52:26.474990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=31 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:26.601816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=31 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:29.827010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569a3b-63fd-42e5-a4f4-cca12a4b2ebd None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:29.827497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569a3b-63fd-42e5-a4f4-cca12a4b2ebd None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:29.827595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569a3b-63fd-42e5-a4f4-cca12a4b2ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:29.875021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-27569a3b-63fd-42e5-a4f4-cca12a4b2ebd None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:29.875021 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-27569a3b-63fd-42e5-a4f4-cca12a4b2ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:29.892416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1122/2285] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:29.927849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:29.944763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b29e6-d3ee-4109-adca-5ef53f62974b service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:29.958842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a030ebe-2892-4d40-82ac-e644cf585016 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:29.959620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a030ebe-2892-4d40-82ac-e644cf585016 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:29.959909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a030ebe-2892-4d40-82ac-e644cf585016 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:29.960186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a030ebe-2892-4d40-82ac-e644cf585016 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:29.972785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a030ebe-2892-4d40-82ac-e644cf585016 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:29.974881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a030ebe-2892-4d40-82ac-e644cf585016 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:29.986778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1164/2286] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:52:37.604252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970f58-888b-4365-80ae-ffbfb38b0748 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:37.605001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970f58-888b-4365-80ae-ffbfb38b0748 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:37.605001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970f58-888b-4365-80ae-ffbfb38b0748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:37.630943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-89970f58-888b-4365-80ae-ffbfb38b0748 None None] MFA Rules not processed for user `64ec7445644e478ca961be80f84f9863`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:37.632293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-89970f58-888b-4365-80ae-ffbfb38b0748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:37.704890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1123/2287] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:52:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:39.980807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=6 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:45.176330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3996df-b9e2-4e4a-9121-bd1564516496 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.176933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3996df-b9e2-4e4a-9121-bd1564516496 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.177044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3996df-b9e2-4e4a-9121-bd1564516496 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.178475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1165/2288] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:52:45.185146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd74e-6557-4704-abb5-88fc1c06963f None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.185566 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd74e-6557-4704-abb5-88fc1c06963f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.185712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafd74e-6557-4704-abb5-88fc1c06963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.206438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5aafd74e-6557-4704-abb5-88fc1c06963f None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:45.207692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5aafd74e-6557-4704-abb5-88fc1c06963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:45.275480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1124/2289] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:52:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:45.287275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3996df-b9e2-4e4a-9121-bd1564516496 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:45.289040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8f3996df-b9e2-4e4a-9121-bd1564516496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:45.350166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3996df-b9e2-4e4a-9121-bd1564516496 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:45.353632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67cea4-d053-40a5-bf8f-f52bc502e2c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:45.354878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67cea4-d053-40a5-bf8f-f52bc502e2c5 service glance] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.355180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67cea4-d053-40a5-bf8f-f52bc502e2c5 service glance] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.355445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67cea4-d053-40a5-bf8f-f52bc502e2c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.365151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67cea4-d053-40a5-bf8f-f52bc502e2c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:45.366557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67cea4-d053-40a5-bf8f-f52bc502e2c5 service glance] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:45.376883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1166/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:45.445953 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5139b6-cc06-48c4-928d-242a0eba9856 None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.446171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5139b6-cc06-48c4-928d-242a0eba9856 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.446448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5139b6-cc06-48c4-928d-242a0eba9856 None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.448315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1125/2291] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:52:45.452869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6671b1-8b87-4a85-b828-d61d882046c8 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.453191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6671b1-8b87-4a85-b828-d61d882046c8 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.453490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6671b1-8b87-4a85-b828-d61d882046c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.472944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7d6671b1-8b87-4a85-b828-d61d882046c8 None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:45.474113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7d6671b1-8b87-4a85-b828-d61d882046c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:45.522622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1167/2292] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:52:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:45.534559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5139b6-cc06-48c4-928d-242a0eba9856 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:45.536306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0e5139b6-cc06-48c4-928d-242a0eba9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:45.549703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5139b6-cc06-48c4-928d-242a0eba9856 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:45.553821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959f60a-f61c-4ab6-98f3-d80162ad5523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:45.556537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959f60a-f61c-4ab6-98f3-d80162ad5523 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.556537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959f60a-f61c-4ab6-98f3-d80162ad5523 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.556537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959f60a-f61c-4ab6-98f3-d80162ad5523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.563528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959f60a-f61c-4ab6-98f3-d80162ad5523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:45.564941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959f60a-f61c-4ab6-98f3-d80162ad5523 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:45.572671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1126/2293] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:45.656594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364db8-6e81-4b45-ab2c-c1714a7d3658 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.657009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364db8-6e81-4b45-ab2c-c1714a7d3658 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.657402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364db8-6e81-4b45-ab2c-c1714a7d3658 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.658834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1168/2294] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:52:45.664599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.664892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.665222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.685408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:45.686593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:45.695780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1127/2295] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:52:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:45.706794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364db8-6e81-4b45-ab2c-c1714a7d3658 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:45.708548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-cc364db8-6e81-4b45-ab2c-c1714a7d3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:45.722295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364db8-6e81-4b45-ab2c-c1714a7d3658 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:45.725949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:45.726543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:45.726855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:45.727151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:45.738396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:45.740015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:45.754198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1169/2296] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:54.286299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:54.288042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:54.372921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff78174-03b3-47b3-b1c9-a54f30fa4aae None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:54.379367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:54.380121 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:54.380407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:54.380676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:54.383137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:54.397017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:54.398990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d2b4d-e9fd-4db6-b6f8-af52cb439715 service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:54.406835 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:52:54.412612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1128/2297] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:54.583555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:54.594529 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426779-ebaa-4fe8-a373-314a4b40e52e service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:54.599895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:54.600645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:54.601072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:54.601493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:54.604277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:54.691083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:54.692640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:54.705294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1170/2298] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:52:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:52:56.263962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6169d-ee5d-4ae4-9255-939187d3040d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:56.263962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6169d-ee5d-4ae4-9255-939187d3040d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:56.264557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6169d-ee5d-4ae4-9255-939187d3040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:56.285650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-e0b6169d-ee5d-4ae4-9255-939187d3040d None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:52:56.287125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e0b6169d-ee5d-4ae4-9255-939187d3040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:52:56.295063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1129/2299] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:52:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:52:56.307374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:52:56.319294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2977-1e28-4f79-8d56-e5460dffe830 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:52:56.325439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:52:56.326059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:52:56.326343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:52:56.326640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:52:56.335388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:52:56.336969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:52:56.361267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1171/2300] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 11:53:06.280610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:06.342702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:20.769742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3d94-94d4-492a-8a65-665e926d150a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:53:20.770187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3d94-94d4-492a-8a65-665e926d150a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:53:20.770291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3d94-94d4-492a-8a65-665e926d150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:53:20.788507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3fcc3d94-94d4-492a-8a65-665e926d150a None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:53:20.789677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3fcc3d94-94d4-492a-8a65-665e926d150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:53:20.796757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1130/2301] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 12 11:53:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:53:20.809310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:53:20.819972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2c56c-e053-45b5-9158-a84ca8dd8285 service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:53:20.824827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630efc-344b-44f0-8bb8-5f962d355061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:53:20.825408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630efc-344b-44f0-8bb8-5f962d355061 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:53:20.825734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630efc-344b-44f0-8bb8-5f962d355061 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:53:20.826508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630efc-344b-44f0-8bb8-5f962d355061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:53:20.834114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630efc-344b-44f0-8bb8-5f962d355061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:53:20.835717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630efc-344b-44f0-8bb8-5f962d355061 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:53:20.843424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1172/2302] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:53:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 11:53:30.783969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:30.840410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=6 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:53:42.238238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616eb40-049b-49ce-86cd-7a45efc7c3e8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:53:42.238764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616eb40-049b-49ce-86cd-7a45efc7c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:53:42.238912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616eb40-049b-49ce-86cd-7a45efc7c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:53:42.257565 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a616eb40-049b-49ce-86cd-7a45efc7c3e8 None None] MFA Rules not processed for user `72a30400dec14a85889af8d8dd59886e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:53:42.258767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a616eb40-049b-49ce-86cd-7a45efc7c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:53:42.313033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1131/2303] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:53:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:53:52.305676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=25 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:12.580153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fa9b0-cde8-49b1-a7ac-fafbbf780797 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:12.580672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fa9b0-cde8-49b1-a7ac-fafbbf780797 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:12.580776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fa9b0-cde8-49b1-a7ac-fafbbf780797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:12.600601 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8f2fa9b0-cde8-49b1-a7ac-fafbbf780797 None None] MFA Rules not processed for user `7d02a90e6cb7428985fe399974b385b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:12.601842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8f2fa9b0-cde8-49b1-a7ac-fafbbf780797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:12.655476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1173/2304] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:54:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:17.774675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:17.775248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:17.775248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:17.794129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] MFA Rules not processed for user `64ec7445644e478ca961be80f84f9863`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:17.795344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:17.806744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1132/2305] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:54:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:22.648826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=25 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:27.789314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:30.981018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:30.981550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:30.982000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:31.018093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] MFA Rules not processed for user `381f8ca947954e01b6255626d4a2888f`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:31.019650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:31.081354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1174/2306] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:54:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:36.234207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:36.251506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8b67-aa1e-40ad-b4fd-5ffa100256ef None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:36.256281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:36.256904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:36.257186 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:36.257461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:36.260667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:36.283273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:36.284773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409891d5-7be2-4e6b-84c0-60c2d2b05f0a service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:36.298034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1133/2307] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:37.489621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:37.499730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf64b2-f9ab-4a4c-8bb0-e8ba5c89d142 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:37.503246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:37.503846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:37.504126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:37.504396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:37.506184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:37.519543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:37.520965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:37.531444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1175/2308] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:38.701786 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:38.702262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:38.702354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:38.721517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:38.722744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:38.729739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1134/2309] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 12 11:54:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:38.775236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:38.786998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79db47-ce4b-411a-97dd-2caec97b7427 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:38.791912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:38.792495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:38.792881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:38.793157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:38.801810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:38.803966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:38.812565 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1176/2310] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:54:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:54:46.259292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:46.260851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:46.329089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0be1db-ecbb-4597-b564-7b63639a4736 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:46.333702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:46.334429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:46.334751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:46.335033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] PATH_INFO: `/v3/users/1227fcf8876a4a0d839c4d9c10626c6e` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:46.336177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1227fcf8876a4a0d839c4d9c10626c6e)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:46.338096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:46.393361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1227fcf8876a4a0d839c4d9c10626c6e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.400919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1227fcf8876a4a0d839c4d9c10626c6e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.413625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1227fcf8876a4a0d839c4d9c10626c6e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.420543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1227fcf8876a4a0d839c4d9c10626c6e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.421225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1227fcf8876a4a0d839c4d9c10626c6e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.427153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1135/2311] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:54:46 2022] DELETE /identity/v3/users/1227fcf8876a4a0d839c4d9c10626c6e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:54:46.596091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:46.607988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c761-611c-4c4d-a123-5222f9165c8d service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:46.670960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:46.671596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:46.671878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:46.672153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] PATH_INFO: `/v3/projects/a91d3226406e4f889c7f3abcd37ec490` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:46.673284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91d3226406e4f889c7f3abcd37ec490)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:46.675432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:46.728181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91d3226406e4f889c7f3abcd37ec490', 'request_id': 'req-2a64026b-813a-4999-9623-94b30aed201a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.748619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91d3226406e4f889c7f3abcd37ec490', 'request_id': 'req-2a64026b-813a-4999-9623-94b30aed201a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.756804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91d3226406e4f889c7f3abcd37ec490', 'request_id': 'req-2a64026b-813a-4999-9623-94b30aed201a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.769572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] The token cache is being invalidate because project a91d3226406e4f889c7f3abcd37ec490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:54:46.769946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.770732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.775701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1177/2312] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:54:46 2022] DELETE /identity/v3/projects/a91d3226406e4f889c7f3abcd37ec490 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:54:46.777602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:46.779731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:46.795889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288ace5-e187-455a-bc5d-7361cc5b9d64 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:46.889800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:46.890654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:46.891057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:46.891438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] PATH_INFO: `/v3/users/2ef06e70cf1f4fe28a5cc95aee7325f3` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:46.892703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef06e70cf1f4fe28a5cc95aee7325f3)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:46.895065 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:46.897210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:46.956024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef06e70cf1f4fe28a5cc95aee7325f3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.964534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef06e70cf1f4fe28a5cc95aee7325f3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:46.988606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef06e70cf1f4fe28a5cc95aee7325f3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.000035 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef06e70cf1f4fe28a5cc95aee7325f3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.001029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef06e70cf1f4fe28a5cc95aee7325f3'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.008362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1136/2313] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:54:46 2022] DELETE /identity/v3/users/2ef06e70cf1f4fe28a5cc95aee7325f3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:54:47.235641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:47.237161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:47.256713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64026b-813a-4999-9623-94b30aed201a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:47.264471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:47.354736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:47.356322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:47.369359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:47.369996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:47.370284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:47.370561 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] PATH_INFO: `/v3/projects/addea9bdac84411dafc8a419fc328dc4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:47.373805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=addea9bdac84411dafc8a419fc328dc4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:47.375881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:47.465828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868da24-e8b4-4827-850d-e62b7d7e8bea admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:47.471329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addea9bdac84411dafc8a419fc328dc4', 'request_id': 'req-25e78669-6938-43a9-88b1-cfea0bfaa783'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.478809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addea9bdac84411dafc8a419fc328dc4', 'request_id': 'req-25e78669-6938-43a9-88b1-cfea0bfaa783'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.494144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addea9bdac84411dafc8a419fc328dc4', 'request_id': 'req-25e78669-6938-43a9-88b1-cfea0bfaa783'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.512524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] The token cache is being invalidate because project addea9bdac84411dafc8a419fc328dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:54:47.512892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.513816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-25e78669-6938-43a9-88b1-cfea0bfaa783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:54:47.516482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1178/2314] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:54:47 2022] DELETE /identity/v3/projects/addea9bdac84411dafc8a419fc328dc4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:54:47.704748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:47.705460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:47.705816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:47.706158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:47.708084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:47.768356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:47.783163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:47.784821 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:47.796486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1137/2315] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:55.395662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:55.396136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:55.396136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:55.414672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] MFA Rules not processed for user `72a30400dec14a85889af8d8dd59886e`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:55.415867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:55.423008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1179/2316] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:54:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:57.792110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:03.049645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:03.051191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:03.062053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cae45-6473-4cab-a05b-2e86da5e96a7 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:03.065668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:03.066249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:03.066513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:03.066823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:03.068471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:03.127687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:03.129105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:03.139174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1138/2317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:05.410027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:11.414506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:11.423040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:11.547781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda7fef-5468-4312-bfaf-58ab2ad7c8a1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:11.555348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:11.556349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:11.556734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:11.557124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:11.559327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:11.636062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:11.637711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:11.649284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1180/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:12.070471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:12.071960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:12.129432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4b37-20de-4627-b5d6-e778d56da3f7 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:12.135893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:12.136542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:12.136789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:12.137087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:12.139618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:12.150241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:12.151851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:12.160610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1139/2319] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:21.645104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=56 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:22.157572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=54 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:22.777680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:22.791166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f8f87-2557-4f79-a2a9-bfbcbeb0a69f service nova] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:22.798221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:22.798864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:22.799160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:22.799411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:22.801119 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:22.814251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:22.816899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:22.828412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1181/2320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:23.509957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:23.518356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4400b-2bcd-47aa-85ad-8184d595d51e service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:23.521922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:23.522513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:23.522825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:23.523099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:23.524756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:23.585879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:23.587308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:23.597097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1140/2321] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:26.781363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:26.782914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:26.848660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:26.850162 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:26.856826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3ed2-89c8-451f-9450-0c3deab36d89 service nova] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:26.862976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:26.863672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:26.864021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:26.864367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:26.866578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:26.869762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236e14-2383-49de-9dce-4c23f57005ce service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:26.876854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:26.877602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:26.877954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:26.878292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] PATH_INFO: `/v3/users/64ec7445644e478ca961be80f84f9863` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:26.884950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ec7445644e478ca961be80f84f9863)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:26.885123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:26.885902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:26.886367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:26.897495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1182/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:26.940846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ec7445644e478ca961be80f84f9863'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:26.950801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ec7445644e478ca961be80f84f9863'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:26.962779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ec7445644e478ca961be80f84f9863'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:26.969429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ec7445644e478ca961be80f84f9863'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:26.970122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a64ad59-4e65-4dc3-a78d-8dfffe776e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ec7445644e478ca961be80f84f9863'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:26.975915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1141/2323] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:26 2022] DELETE /identity/v3/users/64ec7445644e478ca961be80f84f9863 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:27.145703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.157532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9bec6-a5ac-40c6-929e-4e79b1ac2ac7 service placement] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.214516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.215176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.215491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.215768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] PATH_INFO: `/v3/projects/a7e2fce9e9db463aa70188453f20d110` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.216885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e2fce9e9db463aa70188453f20d110)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.219369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.264556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e2fce9e9db463aa70188453f20d110', 'request_id': 'req-45c72db1-6278-48db-b708-4a39f430792c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:27.270359 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e2fce9e9db463aa70188453f20d110', 'request_id': 'req-45c72db1-6278-48db-b708-4a39f430792c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:27.277805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e2fce9e9db463aa70188453f20d110', 'request_id': 'req-45c72db1-6278-48db-b708-4a39f430792c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:27.297579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] The token cache is being invalidate because project a7e2fce9e9db463aa70188453f20d110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:27.297870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:27.298534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-45c72db1-6278-48db-b708-4a39f430792c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:27.300150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1183/2324] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:27 2022] DELETE /identity/v3/projects/a7e2fce9e9db463aa70188453f20d110 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:27.305150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27de7-609e-4798-823d-b63461af69da None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.305542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27de7-609e-4798-823d-b63461af69da None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.305904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27de7-609e-4798-823d-b63461af69da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.325563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-14d27de7-609e-4798-823d-b63461af69da None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:27.326811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-14d27de7-609e-4798-823d-b63461af69da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:27.392505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1142/2325] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:27.400525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.400814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.401092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.415862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:27.422207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:27.424202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:27.432672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1184/2326] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:27.437266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27de7-609e-4798-823d-b63461af69da None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.446851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27de7-609e-4798-823d-b63461af69da None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.451423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.452017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.452299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.452582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.453245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:55:27.453577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.455195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.456621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:27.469391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1143/2327] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:55:27.473689 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.482864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f722b9a-7549-45dd-b57f-7b51d2524669 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.488111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.488703 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.488982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.489253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.489891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.491898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.518834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1185/2328] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:27 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:27.522987 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.533193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702f76-cd7c-4b9b-a1c6-1daa04935335 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.587958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.588544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.588820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.589091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.589689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.591633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.611868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1144/2329] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:27 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:27.616071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.626300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecc700-6ca9-4ce4-b9c6-5b244c228616 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.630811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.631405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.631678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.631950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.632583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.634179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.649406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1186/2330] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:27.653371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.663692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07028d9b-657f-48e1-a2a6-b3066ee9f910 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.668146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583fd9a-f0d9-401b-bd29-6ec5a2bbe5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.668730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583fd9a-f0d9-401b-bd29-6ec5a2bbe5df admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.669006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583fd9a-f0d9-401b-bd29-6ec5a2bbe5df admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.669276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583fd9a-f0d9-401b-bd29-6ec5a2bbe5df admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.669907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583fd9a-f0d9-401b-bd29-6ec5a2bbe5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.671559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583fd9a-f0d9-401b-bd29-6ec5a2bbe5df admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.681741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1145/2331] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:27.686122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.696135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37f7a9-8ea6-44c9-a7f0-6507a32c4865 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.700727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.701364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.701645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.701921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] PATH_INFO: `/v3/projects/da41e9c7c960402396a7896a395623a7/users/631a59cbafa4494c9238f21bfc3623c7/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.716354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da41e9c7c960402396a7896a395623a7, user_id=631a59cbafa4494c9238f21bfc3623c7, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.719682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.732278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1187/2332] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:27 2022] PUT /identity/v3/projects/da41e9c7c960402396a7896a395623a7/users/631a59cbafa4494c9238f21bfc3623c7/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:55:27.746650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.747630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.747937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.776697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] MFA Rules not processed for user `631a59cbafa4494c9238f21bfc3623c7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:27.777888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:27.839226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1146/2333] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:27.852999 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:27.854723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:27.925515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533de25-5e05-47bc-ae52-9eed5e4f4713 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:27.931060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2da6-51ae-49bc-92e3-c6e8c589dfe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:27.931660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2da6-51ae-49bc-92e3-c6e8c589dfe9 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:27.931940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2da6-51ae-49bc-92e3-c6e8c589dfe9 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:27.932213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2da6-51ae-49bc-92e3-c6e8c589dfe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:27.940784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b2da6-51ae-49bc-92e3-c6e8c589dfe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:27.942361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b2da6-51ae-49bc-92e3-c6e8c589dfe9 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:27.951018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1188/2334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:28.164270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:28.225746 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11340c2-3c6c-46a3-ae3f-1b1c440cd15b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:28.230326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:28.230982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.231254 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.231523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] PATH_INFO: `/v3/users/631a59cbafa4494c9238f21bfc3623c7` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.232619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631a59cbafa4494c9238f21bfc3623c7)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:28.234502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:28.236727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:28.280686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631a59cbafa4494c9238f21bfc3623c7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.287127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631a59cbafa4494c9238f21bfc3623c7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.298825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631a59cbafa4494c9238f21bfc3623c7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.305452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631a59cbafa4494c9238f21bfc3623c7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.306083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631a59cbafa4494c9238f21bfc3623c7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.312547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1147/2335] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:28 2022] DELETE /identity/v3/users/631a59cbafa4494c9238f21bfc3623c7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:28.317040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.317327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.317599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.337027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:28.338202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.395427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1189/2336] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:55:28.405625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:28.407267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.464614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5bf60-6221-4246-9418-534523270830 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:28.468309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771582-84b3-47cf-a3d4-22c4103fb7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:28.468911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771582-84b3-47cf-a3d4-22c4103fb7bd service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.469192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771582-84b3-47cf-a3d4-22c4103fb7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.469469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771582-84b3-47cf-a3d4-22c4103fb7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.478374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4771582-84b3-47cf-a3d4-22c4103fb7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:28.479844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4771582-84b3-47cf-a3d4-22c4103fb7bd service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:28.489597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1148/2337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:28.757873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:28.759200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.771090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ebc04-6fa7-4e87-a560-4ec402d744d9 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:28.776728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:28.777809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.778098 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.778373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] PATH_INFO: `/v3/projects/da41e9c7c960402396a7896a395623a7` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.779740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da41e9c7c960402396a7896a395623a7)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:28.782320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:28.808613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:28.831940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da41e9c7c960402396a7896a395623a7', 'request_id': 'req-6260b1be-ca37-49d6-9fd9-240cf76ebb86'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.837902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da41e9c7c960402396a7896a395623a7', 'request_id': 'req-6260b1be-ca37-49d6-9fd9-240cf76ebb86'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.845625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da41e9c7c960402396a7896a395623a7', 'request_id': 'req-6260b1be-ca37-49d6-9fd9-240cf76ebb86'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.855795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] The token cache is being invalidate because project da41e9c7c960402396a7896a395623a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:28.856347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.856893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6260b1be-ca37-49d6-9fd9-240cf76ebb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:28.858498 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1190/2338] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:28 2022] DELETE /identity/v3/projects/da41e9c7c960402396a7896a395623a7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:28.864939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.865290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.865626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.884621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:28.885792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.942887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1149/2339] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:28.950784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.951071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.951344 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.971115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:28.972316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.980270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1191/2340] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:28.984957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:28.994310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb96922-39b5-4a54-8fe4-9705b13ff784 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:28.998859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:28.999447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.999727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.999998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.000635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:55:29.000936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.002513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.013725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1150/2341] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:55:29.017835 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.026979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ce96d-ba6b-405f-8b96-b44a604ecd11 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.032097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.032683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.032958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.033230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.033855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.035773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.062392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1192/2342] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:29.066481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.076361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7053-f7d5-4992-8596-57044538dc39 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.084473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:29.134367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.135025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.135306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.135581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.136194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.138099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.159265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1151/2343] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:55:29.163337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.173211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc91f1b-49c9-4bb9-8883-5778785e0c04 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.177751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.178335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.178637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.178908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.179541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.181116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.190937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1193/2344] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:29.194864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.204716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4717df3-51d9-43ab-bf05-ed4896621279 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.209266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf73688-8f14-46eb-ba30-954068e1ee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.209843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73688-8f14-46eb-ba30-954068e1ee5b admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.210118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73688-8f14-46eb-ba30-954068e1ee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.210388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73688-8f14-46eb-ba30-954068e1ee5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.211060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf73688-8f14-46eb-ba30-954068e1ee5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.212637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf73688-8f14-46eb-ba30-954068e1ee5b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.223321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1152/2345] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:55:29.227388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.238579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2186a-3129-4758-bef0-bc43bee1f7c4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.243782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.244283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.244727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.245014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] PATH_INFO: `/v3/projects/2ebffa014c044b369434e7d4e25e3e28/users/bd72febfc4b846cfb27f24d86ae02830/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.262817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebffa014c044b369434e7d4e25e3e28, user_id=bd72febfc4b846cfb27f24d86ae02830, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.267423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.283088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1194/2346] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:29 2022] PUT /identity/v3/projects/2ebffa014c044b369434e7d4e25e3e28/users/bd72febfc4b846cfb27f24d86ae02830/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:29.293841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.294210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.294514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.321514 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] MFA Rules not processed for user `bd72febfc4b846cfb27f24d86ae02830`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:29.325011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:29.392754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1153/2347] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:29.397551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.460746 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17272ba-228d-4e26-b117-6c241b21476e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.465381 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.465983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.466266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.466537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.467194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.469112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.496801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1195/2348] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:29.501563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.514655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7b0a3-f846-420c-986c-4c840e9da764 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.569531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.570130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.570415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.570722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.571345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.573240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.593837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1154/2349] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:55:29.597839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.607818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359cc01-4a6e-4db2-b87d-aee6288695f4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.612642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.613253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.613545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.613819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.614465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.616096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.628184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1196/2350] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:29.632309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.642708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f10695-d651-48a5-a5b5-2e0a722b3b15 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.647287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.647911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.648190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.648463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] PATH_INFO: `/v3/projects/8f1ce6533e0c4ee592b90f4cde27cc57/users/aed97a3f2432434182fbd6808337c336/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.651417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:29.664181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ce6533e0c4ee592b90f4cde27cc57, user_id=aed97a3f2432434182fbd6808337c336, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.666840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.679031 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1155/2351] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:29 2022] PUT /identity/v3/projects/8f1ce6533e0c4ee592b90f4cde27cc57/users/aed97a3f2432434182fbd6808337c336/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:29.682861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.693373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bbb7-16e6-437d-8bc3-4a13e2d84573 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.711388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:29.752012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2bcd-769f-42a1-a666-24c687474ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.752641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2bcd-769f-42a1-a666-24c687474ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.752925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2bcd-769f-42a1-a666-24c687474ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.753200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2bcd-769f-42a1-a666-24c687474ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.753842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa2bcd-769f-42a1-a666-24c687474ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.755467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa2bcd-769f-42a1-a666-24c687474ac1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.766251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1197/2352] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:29.770434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.780496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f2ff-9b87-402c-b89a-b95a87a52993 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.784965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.785602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.785884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.786159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] PATH_INFO: `/v3/projects/8f1ce6533e0c4ee592b90f4cde27cc57/users/aed97a3f2432434182fbd6808337c336/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.788051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ce6533e0c4ee592b90f4cde27cc57, user_id=aed97a3f2432434182fbd6808337c336, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.790691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.800519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1156/2353] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:29 2022] PUT /identity/v3/projects/8f1ce6533e0c4ee592b90f4cde27cc57/users/aed97a3f2432434182fbd6808337c336/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:29.811995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.812802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.813079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.840833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] MFA Rules not processed for user `aed97a3f2432434182fbd6808337c336`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:29.842041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:29.908070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1198/2354] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:29.919082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:29.920833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:29.977770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667428-5c27-4986-afbc-6106d9370da0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:29.981353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.982165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.982451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.982760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.992216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.993622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:30.003417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1157/2355] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:30.149313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:30.158747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b508a-397c-45d9-b8e9-2a3243096ecd None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:30.162202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473b59e-d54f-4624-94bf-c133b2fcbd12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:30.162814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b59e-d54f-4624-94bf-c133b2fcbd12 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:30.163095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b59e-d54f-4624-94bf-c133b2fcbd12 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:30.163362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b59e-d54f-4624-94bf-c133b2fcbd12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:30.217329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473b59e-d54f-4624-94bf-c133b2fcbd12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:30.219279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473b59e-d54f-4624-94bf-c133b2fcbd12 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:30.227928 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1199/2356] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:30.510947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:30.513401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:30.626137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bce1e-6462-4b72-ae6b-0914faa63935 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:30.631731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:30.632413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:30.632690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:30.632959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:30.634756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:30.694014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:30.695626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:30.706420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1158/2357] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:31.733578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:31.734083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:31.734819 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:31.756111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:31.757485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:31.804472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:31.828735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1200/2358] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:55:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:31.841132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:31.842516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:31.856430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:31.921200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efcbc1-faeb-4713-b597-2b079199af11 service nova] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:31.926402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:31.927053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:31.927359 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:31.927634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:31.935416 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:31.937751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:31.945539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1159/2359] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:55:34.879335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:34.880813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:34.920434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e47e2-22ff-4d44-bec6-add34ec3c5ed None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:34.934224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:34.934891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:34.935969 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:34.936248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:34.940839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:34.977029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:34.980744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94592db-c203-48be-a4b4-3b2227f17d89 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:35.008324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1201/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:38.883865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:38.971918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d57d9a-ac9d-495f-b790-464d73dcc84c service swift] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:38.982699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:38.983481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:38.983905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:38.984272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] PATH_INFO: `/v3/users/bd72febfc4b846cfb27f24d86ae02830` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:38.985529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd72febfc4b846cfb27f24d86ae02830)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:38.987731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:39.057955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd72febfc4b846cfb27f24d86ae02830'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.069505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd72febfc4b846cfb27f24d86ae02830'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.090654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd72febfc4b846cfb27f24d86ae02830'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.099710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd72febfc4b846cfb27f24d86ae02830'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.100734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd72febfc4b846cfb27f24d86ae02830'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.111391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1160/2361] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:38 2022] DELETE /identity/v3/users/bd72febfc4b846cfb27f24d86ae02830 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:39.114329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:39.115407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:39.116412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:39.137762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:39.138899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:39.211135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1202/2362] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:39.221708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:39.223197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:39.245865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:39.298984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeff7f-75cc-47f4-a21a-1998eca43576 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:39.314757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:39.315431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:39.315715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:39.315992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:39.330171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:39.331643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:39.344884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1161/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:39.661215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:39.663252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:39.677089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd09f6-5108-4afc-9440-5fd26aed61c3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:39.682069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:39.682712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:39.683072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:39.683374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] PATH_INFO: `/v3/projects/2ebffa014c044b369434e7d4e25e3e28` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:39.684633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebffa014c044b369434e7d4e25e3e28)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:39.686980 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:39.756430 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebffa014c044b369434e7d4e25e3e28', 'request_id': 'req-7daceb90-f841-4fc7-a912-78c4bd4a7883'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.763537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebffa014c044b369434e7d4e25e3e28', 'request_id': 'req-7daceb90-f841-4fc7-a912-78c4bd4a7883'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.772851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebffa014c044b369434e7d4e25e3e28', 'request_id': 'req-7daceb90-f841-4fc7-a912-78c4bd4a7883'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.784613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] The token cache is being invalidate because project 2ebffa014c044b369434e7d4e25e3e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:39.784953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.785652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.787164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1203/2364] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:39 2022] DELETE /identity/v3/projects/2ebffa014c044b369434e7d4e25e3e28 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:39.791266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:39.804653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fba2-88dd-4334-9958-2f78fbad1fd4 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:39.901680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:39.902933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:39.903377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:39.903826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] PATH_INFO: `/v3/users/aed97a3f2432434182fbd6808337c336` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:39.905192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed97a3f2432434182fbd6808337c336)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:39.907437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:39.967248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed97a3f2432434182fbd6808337c336'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.978501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed97a3f2432434182fbd6808337c336'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:39.993726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed97a3f2432434182fbd6808337c336'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.001171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed97a3f2432434182fbd6808337c336'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.002006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cdedab5f-78c5-4923-b075-825f9d5b023f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed97a3f2432434182fbd6808337c336'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.008446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1162/2365] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:39 2022] DELETE /identity/v3/users/aed97a3f2432434182fbd6808337c336 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:40.379748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.387679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:40.407257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daceb90-f841-4fc7-a912-78c4bd4a7883 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.463938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:40.473373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.474273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.474940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.475816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] PATH_INFO: `/v3/projects/8f1ce6533e0c4ee592b90f4cde27cc57` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.477129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1ce6533e0c4ee592b90f4cde27cc57)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:40.479105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:40.532059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1ce6533e0c4ee592b90f4cde27cc57', 'request_id': 'req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.539105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1ce6533e0c4ee592b90f4cde27cc57', 'request_id': 'req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.548125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1ce6533e0c4ee592b90f4cde27cc57', 'request_id': 'req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.561780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] The token cache is being invalidate because project 8f1ce6533e0c4ee592b90f4cde27cc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:40.562195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.562828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4a48b0c-e1b2-477b-b1a7-cd2c9f132696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:40.564585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1204/2366] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:40 2022] DELETE /identity/v3/projects/8f1ce6533e0c4ee592b90f4cde27cc57 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:40.569678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.569994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.570232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.591284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:40.592504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:40.647239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:40.670402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1163/2367] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:40.678914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.679203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.679506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.699837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:40.701029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:40.709501 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1205/2368] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:40.713895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.723641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6057b-7505-4582-9a8b-3363530b3977 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.728226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.728827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.729107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.729374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.730013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:55:40.730311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:40.731928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:40.743968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1164/2369] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:55:40.748682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.758305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad792c-64ad-4529-ae34-727a789fe57b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.762882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.763469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.763747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.764018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.764631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:40.767251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:40.792974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1206/2370] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:40 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:55:40.797061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.806833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330cade-12b3-4781-a3fb-7d0fcd54f4e6 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.870781 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.871417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.871701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.871975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.872607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:40.875127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:40.896341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1165/2371] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:40 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:40.905452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.915666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e0f6-ac8b-4380-94aa-06d7f30fa5e6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.920259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.920854 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.921133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.921405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.922041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:40.923715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:40.933215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1207/2372] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:40.937985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.948294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e577c-66b8-4cc9-a1b9-0df0bdafd0a4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.953542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aedc71-e98d-4a2d-930a-fee6c82d471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.954138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedc71-e98d-4a2d-930a-fee6c82d471e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.954422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedc71-e98d-4a2d-930a-fee6c82d471e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.954736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedc71-e98d-4a2d-930a-fee6c82d471e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.955383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aedc71-e98d-4a2d-930a-fee6c82d471e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:40.956967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aedc71-e98d-4a2d-930a-fee6c82d471e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:40.967368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1166/2373] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:40.971546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.981292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8562b3-6444-4f26-939b-ac50ff7613b0 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:40.986082 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:40.986764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.987070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.987345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] PATH_INFO: `/v3/projects/543c8cdd83144d83aa9b08a01eaa486d/users/c27cbb9a05554905acfb39a5186becac/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.002153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=543c8cdd83144d83aa9b08a01eaa486d, user_id=c27cbb9a05554905acfb39a5186becac, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.004838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.018321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1208/2374] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:40 2022] PUT /identity/v3/projects/543c8cdd83144d83aa9b08a01eaa486d/users/c27cbb9a05554905acfb39a5186becac/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:55:41.028665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.028955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.029234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.056131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] MFA Rules not processed for user `c27cbb9a05554905acfb39a5186becac`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:41.057332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:41.120770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1167/2375] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:41.125609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.191719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10181b33-774f-42e5-b02a-77647ea40e6b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.196336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.196932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.197213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.197487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.198095 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.200036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.225618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1209/2376] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:41.229363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.241211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db15a-e2e0-4918-8e5c-1358fc5e5da0 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.276958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:41.302059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.302807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.303168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.303541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.304324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.306455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.329238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1168/2377] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:55:41.333420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.343742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a59d98-df63-4b58-85d0-d458a7a47501 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.348702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.349360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.349704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.350045 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.350813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.352401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.354545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:41.364874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1210/2378] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:41.369292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.379790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831638-239e-4dd1-8290-1080a347e446 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.384462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f159f44-a5ab-4e64-a652-5410f6801982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.385060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159f44-a5ab-4e64-a652-5410f6801982 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.385377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159f44-a5ab-4e64-a652-5410f6801982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.385656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159f44-a5ab-4e64-a652-5410f6801982 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.386415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f159f44-a5ab-4e64-a652-5410f6801982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.388042 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f159f44-a5ab-4e64-a652-5410f6801982 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.400112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1169/2379] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:41.404284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.414452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32403e-5ed3-4846-b725-800105da3615 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.420519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.421184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.421944 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.422216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] PATH_INFO: `/v3/projects/aa6285ba155e4ed79c05c3062be26fd8/users/a8a1127bd2d34645b3a8b6e839e027fb/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.439648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6285ba155e4ed79c05c3062be26fd8, user_id=a8a1127bd2d34645b3a8b6e839e027fb, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.442290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.456692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1211/2380] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:41 2022] PUT /identity/v3/projects/aa6285ba155e4ed79c05c3062be26fd8/users/a8a1127bd2d34645b3a8b6e839e027fb/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:41.469764 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.470144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.470498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.510779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] MFA Rules not processed for user `a8a1127bd2d34645b3a8b6e839e027fb`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:41.510779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:41.568267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1170/2381] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:41.572713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.634930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7b24-f10a-4179-bd20-47db95d0ed80 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.639616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.640247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.640527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.641527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.642175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.644118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.673370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1212/2382] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:41.677573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.692023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e00365-1623-4c30-8b0b-b7b0900f9a86 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.750502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.751142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.751453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.751726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.752338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.754279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.775111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1171/2383] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:55:41.779145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.789130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d0ba9-915d-498d-ae02-86d03a7e9f08 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.793642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.794240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.794504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.794801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.795434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.797018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.807219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1213/2384] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:55:41.811382 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.821632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c5c71-5ebe-4474-8d60-1250e269fd6e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.826232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.826910 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.827198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.828147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] PATH_INFO: `/v3/projects/b02f41b0674041d0a70918acd5013060/users/4886d99da29a4b699760ac0a547c3dc0/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.842944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02f41b0674041d0a70918acd5013060, user_id=4886d99da29a4b699760ac0a547c3dc0, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.845598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.858239 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1172/2385] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:41 2022] PUT /identity/v3/projects/b02f41b0674041d0a70918acd5013060/users/4886d99da29a4b699760ac0a547c3dc0/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:41.862788 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.872699 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b55a-9e86-4e53-a5ff-31a63660d67c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.929084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee531236-076a-4e42-a926-fba658dc5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.929675 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531236-076a-4e42-a926-fba658dc5e01 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.929953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531236-076a-4e42-a926-fba658dc5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.930225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531236-076a-4e42-a926-fba658dc5e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.930903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee531236-076a-4e42-a926-fba658dc5e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.932542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee531236-076a-4e42-a926-fba658dc5e01 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.942688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1214/2386] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:55:41.947163 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:41.957588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc47a-8b2d-4ace-917e-4308590b2e6a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.962438 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.963137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.963415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.963688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] PATH_INFO: `/v3/projects/b02f41b0674041d0a70918acd5013060/users/4886d99da29a4b699760ac0a547c3dc0/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.965757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02f41b0674041d0a70918acd5013060, user_id=4886d99da29a4b699760ac0a547c3dc0, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.968461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.978633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:41.984553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1173/2387] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:41 2022] PUT /identity/v3/projects/b02f41b0674041d0a70918acd5013060/users/4886d99da29a4b699760ac0a547c3dc0/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:41.995463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.995700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.995915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:42.029402 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] MFA Rules not processed for user `4886d99da29a4b699760ac0a547c3dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:42.031065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:42.068205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:42.113096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1215/2388] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:42.125306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:42.127811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:42.198521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b848-b340-4081-9668-f89b8187e20a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:42.202207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:42.202903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:42.203182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:42.203454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:42.260922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:42.262345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:42.271205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1174/2389] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:43.811323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:43.820814 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd53-cc78-4ae1-b85b-75a94cccbc0c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:43.824280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:43.824876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:43.825151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:43.825419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:43.884239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:43.885677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:43.898991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1216/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:44.490896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:44.499447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346f6a-28de-45dc-93f7-918d4cdfce86 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:44.503001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef805e0-cd50-4971-98b3-d6f398de57b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:44.503587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef805e0-cd50-4971-98b3-d6f398de57b9 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:44.503875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef805e0-cd50-4971-98b3-d6f398de57b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:44.504127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef805e0-cd50-4971-98b3-d6f398de57b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:44.512737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef805e0-cd50-4971-98b3-d6f398de57b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:44.514124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef805e0-cd50-4971-98b3-d6f398de57b9 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:44.523238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1175/2391] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:45.849950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:45.851602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:45.927328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d673-2e32-48c3-936a-a7c3df7ebc91 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:45.931763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:45.932626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:45.933203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:45.933779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:45.935718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:45.946384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:45.947954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808856-ce0a-45aa-ae5d-75ad04fb082f service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:45.957545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1217/2392] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:46.089649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cc406-40aa-4990-82a4-954629d5119f None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.090204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cc406-40aa-4990-82a4-954629d5119f None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.090204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cc406-40aa-4990-82a4-954629d5119f None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.091577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1176/2393] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:46.098287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeb08d-8943-42ae-ba6d-6e31cb8e8ff1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.098593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeb08d-8943-42ae-ba6d-6e31cb8e8ff1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.098926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeb08d-8943-42ae-ba6d-6e31cb8e8ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.120024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-91aeb08d-8943-42ae-ba6d-6e31cb8e8ff1 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:46.121390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-91aeb08d-8943-42ae-ba6d-6e31cb8e8ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.193330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1218/2394] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:55:46.205092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cc406-40aa-4990-82a4-954629d5119f None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:46.206941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5e2cc406-40aa-4990-82a4-954629d5119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.263984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cc406-40aa-4990-82a4-954629d5119f None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:46.267534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f7ad6-7f12-422c-a537-f200b36b3e79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:46.268140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7ad6-7f12-422c-a537-f200b36b3e79 service glance] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.268423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7ad6-7f12-422c-a537-f200b36b3e79 service glance] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.268699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7ad6-7f12-422c-a537-f200b36b3e79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.278758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f7ad6-7f12-422c-a537-f200b36b3e79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:46.280266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f7ad6-7f12-422c-a537-f200b36b3e79 service glance] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:46.294581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1177/2395] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:46.363958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232d311-d0ba-4eab-b34c-cdefea298349 None None] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.364253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232d311-d0ba-4eab-b34c-cdefea298349 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.364537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232d311-d0ba-4eab-b34c-cdefea298349 None None] PATH_INFO: `/` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.365887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1219/2396] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:46.370460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d9dd1-ffa2-4e71-bd72-c617609daaf8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.370775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d9dd1-ffa2-4e71-bd72-c617609daaf8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.371053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d9dd1-ffa2-4e71-bd72-c617609daaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.390529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-dc2d9dd1-ffa2-4e71-bd72-c617609daaf8 None None] MFA Rules not processed for user `209260a51d244372a392acf3176e8303`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:46.391745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dc2d9dd1-ffa2-4e71-bd72-c617609daaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.398097 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1178/2397] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:46.410006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232d311-d0ba-4eab-b34c-cdefea298349 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:46.411695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0232d311-d0ba-4eab-b34c-cdefea298349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.419257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:46.425913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232d311-d0ba-4eab-b34c-cdefea298349 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:46.429439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c4ecb-5420-4c58-b167-ea6440755f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:46.430027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c4ecb-5420-4c58-b167-ea6440755f4c service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.430306 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c4ecb-5420-4c58-b167-ea6440755f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.430579 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c4ecb-5420-4c58-b167-ea6440755f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.437665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c4ecb-5420-4c58-b167-ea6440755f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:46.439129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c4ecb-5420-4c58-b167-ea6440755f4c service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:46.446728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1220/2398] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:46.527463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6833-6584-4e83-a765-b88a0952f04e None None] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.527753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6833-6584-4e83-a765-b88a0952f04e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.528028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff6833-6584-4e83-a765-b88a0952f04e None None] PATH_INFO: `/` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.529371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1179/2399] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 12 11:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:46.535317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.535683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.536023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.555100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] MFA Rules not processed for user `1b3bee55e837447180812b0f2bb2abd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:46.556491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.565959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1221/2400] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 12 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:46.580157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6833-6584-4e83-a765-b88a0952f04e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:46.588225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff6833-6584-4e83-a765-b88a0952f04e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:46.591863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:46.592447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.592724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.593622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.605302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:46.606803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:46.617257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1180/2401] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:46.678379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:46.679805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.745572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca326a29-28c9-47de-8cb8-aab14c2a9177 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:46.751152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:46.751751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.752030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.752302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.754000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.765697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:46.767336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d22d3-0497-4103-a9fe-37b92a1ba8fa service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:46.777024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1222/2402] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:48.424485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:48.450573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:48.480280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.480784 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.480871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.498406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a78a-c46f-40f8-865d-3acea3b57e55 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:48.501204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:48.502442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.505201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:48.506152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.506699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.507545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] PATH_INFO: `/v3/users/c27cbb9a05554905acfb39a5186becac` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.509844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27cbb9a05554905acfb39a5186becac)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:48.512442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:48.578279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1223/2403] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:55:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:55:48.581899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27cbb9a05554905acfb39a5186becac'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:48.595003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27cbb9a05554905acfb39a5186becac'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:48.596509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:48.598550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.613494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27cbb9a05554905acfb39a5186becac'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:48.621679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27cbb9a05554905acfb39a5186becac'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:48.622493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fdb51c6-4a21-4bb8-8111-09abcb4040af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27cbb9a05554905acfb39a5186becac'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:48.631643 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1181/2404] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:48 2022] DELETE /identity/v3/users/c27cbb9a05554905acfb39a5186becac => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:48.640178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.640581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.640875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.662939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:48.665637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.712088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a797822-dc51-416b-984d-d40d003fb5b0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:48.730744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:48.732645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1182/2405] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:48.742534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:48.744128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.795548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:48.795735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:48.797626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.798533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.798997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.800892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.810108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3b5c-4d6a-4bf4-a6f7-dc439ff5e325 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:48.815158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:48.815796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.816046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.816319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.827395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:48.828970 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:48.839561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1183/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:48.869623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:48.871313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:48.880660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1224/2407] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:55:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:55:49.175587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:49.178247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:49.218436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc81152-638d-4e7e-b6f9-9ac7bc15c118 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:49.238561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:49.239381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:49.239594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:49.239904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] PATH_INFO: `/v3/projects/543c8cdd83144d83aa9b08a01eaa486d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:49.241656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=543c8cdd83144d83aa9b08a01eaa486d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:49.243623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:49.319370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543c8cdd83144d83aa9b08a01eaa486d', 'request_id': 'req-cfb55892-67b0-4696-929d-e8ab91b70c11'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.331094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543c8cdd83144d83aa9b08a01eaa486d', 'request_id': 'req-cfb55892-67b0-4696-929d-e8ab91b70c11'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.341207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543c8cdd83144d83aa9b08a01eaa486d', 'request_id': 'req-cfb55892-67b0-4696-929d-e8ab91b70c11'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.357952 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] The token cache is being invalidate because project 543c8cdd83144d83aa9b08a01eaa486d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:49.358305 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.359680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.361496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1184/2408] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:49 2022] DELETE /identity/v3/projects/543c8cdd83144d83aa9b08a01eaa486d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:49.365797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:49.379201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940ccc1-e7fb-45cd-a9d0-b6f123851df3 service swift] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:49.445324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:49.445873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:49.446156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:49.446435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] PATH_INFO: `/v3/users/a8a1127bd2d34645b3a8b6e839e027fb` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:49.447602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a1127bd2d34645b3a8b6e839e027fb)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:49.449556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:49.505342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a1127bd2d34645b3a8b6e839e027fb'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.512137 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a1127bd2d34645b3a8b6e839e027fb'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.519427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a1127bd2d34645b3a8b6e839e027fb'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.520681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:49.535211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a1127bd2d34645b3a8b6e839e027fb'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.535939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a1127bd2d34645b3a8b6e839e027fb'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:49.541727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1225/2409] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:49 2022] DELETE /identity/v3/users/a8a1127bd2d34645b3a8b6e839e027fb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:55:49.909713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:49.911584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:49.936978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb55892-67b0-4696-929d-e8ab91b70c11 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:50.039274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:50.040054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:50.040434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:50.040729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] PATH_INFO: `/v3/projects/aa6285ba155e4ed79c05c3062be26fd8` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:50.041986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6285ba155e4ed79c05c3062be26fd8)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:50.044224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:50.108791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6285ba155e4ed79c05c3062be26fd8', 'request_id': 'req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.117054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6285ba155e4ed79c05c3062be26fd8', 'request_id': 'req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.125974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6285ba155e4ed79c05c3062be26fd8', 'request_id': 'req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.132446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:50.137716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] The token cache is being invalidate because project aa6285ba155e4ed79c05c3062be26fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:50.138365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.140335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.142198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1185/2410] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:49 2022] DELETE /identity/v3/projects/aa6285ba155e4ed79c05c3062be26fd8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:50.146079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:50.147511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:50.160912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757dafd-3ae4-486d-82d7-bb91bcc4dcef admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:50.216775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:50.217640 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:50.217905 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:50.218179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] PATH_INFO: `/v3/users/4886d99da29a4b699760ac0a547c3dc0` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:50.219566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4886d99da29a4b699760ac0a547c3dc0)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:50.221618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:50.279615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4886d99da29a4b699760ac0a547c3dc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.286971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4886d99da29a4b699760ac0a547c3dc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.293918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4886d99da29a4b699760ac0a547c3dc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.306556 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4886d99da29a4b699760ac0a547c3dc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.307232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-06ec5c5b-5fdb-4538-b47e-baeef1d06020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4886d99da29a4b699760ac0a547c3dc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.314153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1226/2411] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:55:50 2022] DELETE /identity/v3/users/4886d99da29a4b699760ac0a547c3dc0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:55:50.605225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:50.606834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:50.640238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a2b56-0a1c-45d7-a3f8-ddcae7b66e4b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:50.704648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:50.705281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:50.705559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:50.705841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] PATH_INFO: `/v3/projects/b02f41b0674041d0a70918acd5013060` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:50.706964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02f41b0674041d0a70918acd5013060)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:50.709100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:50.761212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02f41b0674041d0a70918acd5013060', 'request_id': 'req-87763663-bd18-44e6-a38f-badde8bafc97'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.769747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02f41b0674041d0a70918acd5013060', 'request_id': 'req-87763663-bd18-44e6-a38f-badde8bafc97'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.781434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02f41b0674041d0a70918acd5013060', 'request_id': 'req-87763663-bd18-44e6-a38f-badde8bafc97'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.793826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] The token cache is being invalidate because project b02f41b0674041d0a70918acd5013060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:55:50.794247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.795257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-87763663-bd18-44e6-a38f-badde8bafc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:55:50.797320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1186/2412] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:55:50 2022] DELETE /identity/v3/projects/b02f41b0674041d0a70918acd5013060 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:50.801910 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:50.802377 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:50.802642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:50.822777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:50.823984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:50.887705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:50.902665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1227/2413] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:50.910225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:50.910818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:50.910818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:50.930773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:50.931978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:50.940856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1187/2414] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:50.945462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:50.960826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baadc87-4a76-43ac-9c5f-a5952ba77350 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:50.966695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:50.967514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:50.968021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:50.968544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:50.969362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:55:50.969823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:50.972021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:50.985464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1228/2415] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:55:50.990059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:51.000674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075a881-66db-4f33-8047-1387e7f19c04 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:51.005526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:51.006225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.006580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.006960 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.007671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:51.009702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:51.037883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1188/2416] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:55:50 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:51.043006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:51.056107 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12182-bbac-4d85-ae54-abaec887d97e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:51.121804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:51.122420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.122735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.123014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.123655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:51.126153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:51.149599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1229/2417] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:55:51 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:55:51.153979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:51.165508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7d939-58d6-4b3d-bfb1-ca9177cfbdf4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:51.170383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:51.171619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.171904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.172177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.176034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:51.176034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:51.192337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1189/2418] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:51.193862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:51.205143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66574aa2-d530-400d-a8c3-11fb19f8523e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:51.210136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41597-6f51-43a2-84a7-18ea13f34b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:51.210898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41597-6f51-43a2-84a7-18ea13f34b56 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.211278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41597-6f51-43a2-84a7-18ea13f34b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.211649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41597-6f51-43a2-84a7-18ea13f34b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.212418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41597-6f51-43a2-84a7-18ea13f34b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:51.214346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41597-6f51-43a2-84a7-18ea13f34b56 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:51.232998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1230/2419] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:55:51.234978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:51.258862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158921c-2fed-418b-b45f-e44bac7283b5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:51.263859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:51.264591 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.265004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.265352 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] PATH_INFO: `/v3/projects/7d5216358d1849a7aa9f2e1d8f4cfd13/users/679bdd55dfde4e5d800690c7b950243c/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.279896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5216358d1849a7aa9f2e1d8f4cfd13, user_id=679bdd55dfde4e5d800690c7b950243c, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:51.283080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:51.295716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1190/2420] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:55:51 2022] PUT /identity/v3/projects/7d5216358d1849a7aa9f2e1d8f4cfd13/users/679bdd55dfde4e5d800690c7b950243c/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:55:51.307280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9e90-6a93-492b-8a9d-73cc3b79be46 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.307514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9e90-6a93-492b-8a9d-73cc3b79be46 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.307791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9e90-6a93-492b-8a9d-73cc3b79be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.337627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-694e9e90-6a93-492b-8a9d-73cc3b79be46 None None] MFA Rules not processed for user `679bdd55dfde4e5d800690c7b950243c`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:51.338878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-694e9e90-6a93-492b-8a9d-73cc3b79be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:51.414206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1231/2421] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:55:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:55:51.427299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:51.429607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:51.467210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:51.498445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ef293-fb2b-4f36-9327-ed75bb276e7c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:51.502132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:51.502802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.503086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.503360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.511396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:51.513079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:51.522425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1191/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:01.411449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:01.523128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=15 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:05.425550 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:05.426003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:05.426134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:05.445106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:05.446285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:05.501208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1232/2423] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 12 11:56:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:05.513539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:05.515593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:05.582586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db5cf-04a1-4da1-9a9d-a4ecaa255726 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:05.587581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:05.588199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:05.588481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:05.588751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:05.596588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:05.598132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:05.605812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1192/2424] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:56:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:56:15.493546 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=25 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:15.602883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=32 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:23.705849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:23.707750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:23.768535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb2221-cbb5-4148-9a76-976cc54a7952 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:23.772097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:23.772706 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:23.772984 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:23.773260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:23.774986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:23.836808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:23.838245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:23.848785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1233/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:24.413743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:24.422825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab38a1-6f22-4f3f-9b35-dde4efeba304 service swift] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:24.426349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:24.426980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:24.427263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:24.427537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:24.429247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:24.442116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:24.443564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8333e-e601-4cfe-9eb1-1c4a2303e360 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:24.453126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1193/2426] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:27.063711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:27.075093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6431764-3c32-4ab1-b239-ae110f1bcc42 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:27.081156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:27.082654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:27.083121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:27.083840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] PATH_INFO: `/v3/users/679bdd55dfde4e5d800690c7b950243c` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:27.085481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] RBAC: Authorizing `identity:delete_user(user_id=679bdd55dfde4e5d800690c7b950243c)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:27.087841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:27.140039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679bdd55dfde4e5d800690c7b950243c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:27.152917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679bdd55dfde4e5d800690c7b950243c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:27.167843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679bdd55dfde4e5d800690c7b950243c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:27.216630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679bdd55dfde4e5d800690c7b950243c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:27.217536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679bdd55dfde4e5d800690c7b950243c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:27.228716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1234/2427] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:27 2022] DELETE /identity/v3/users/679bdd55dfde4e5d800690c7b950243c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:27.233191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:27.233772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:27.233772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:27.263603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:27.265045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:27.342363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1194/2428] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:27.355569 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:27.357652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:27.404084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:27.453608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121a22-bbc6-441c-8311-1be3d168584b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:27.459897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2202a-94e9-4314-93ac-223a513e90b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:27.460756 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2202a-94e9-4314-93ac-223a513e90b2 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:27.461246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2202a-94e9-4314-93ac-223a513e90b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:27.461598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2202a-94e9-4314-93ac-223a513e90b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:27.476323 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2202a-94e9-4314-93ac-223a513e90b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:27.479907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2202a-94e9-4314-93ac-223a513e90b2 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:27.501438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1235/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:28.248785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.250314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.264724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecc22-7e14-411b-bfe4-de9a7429c0c7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.270022 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.270727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.271011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.271277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] PATH_INFO: `/v3/projects/7d5216358d1849a7aa9f2e1d8f4cfd13` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.273386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5216358d1849a7aa9f2e1d8f4cfd13)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.276038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.342149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5216358d1849a7aa9f2e1d8f4cfd13', 'request_id': 'req-5e727163-b6e8-422d-92a3-b3de9b682ab2'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:28.351426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5216358d1849a7aa9f2e1d8f4cfd13', 'request_id': 'req-5e727163-b6e8-422d-92a3-b3de9b682ab2'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:28.363759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5216358d1849a7aa9f2e1d8f4cfd13', 'request_id': 'req-5e727163-b6e8-422d-92a3-b3de9b682ab2'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:28.379195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] The token cache is being invalidate because project 7d5216358d1849a7aa9f2e1d8f4cfd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:28.380259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:28.381202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e727163-b6e8-422d-92a3-b3de9b682ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:28.383712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1195/2430] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:28 2022] DELETE /identity/v3/projects/7d5216358d1849a7aa9f2e1d8f4cfd13 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:28.392217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.393918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.394500 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.439652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:28.441086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.541534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1236/2431] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:28.545488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.545812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.546089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.570448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:28.570844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.581051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1196/2432] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:28.586688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.609096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3e450-1c35-42a6-9484-a737a916b5fc None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.614499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.615484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.615894 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.616270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.617028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:28.617431 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.619434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.636560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1237/2433] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:28.640999 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.651337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c85f8-aba3-47da-ab2e-3a260d04db26 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.656221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.656895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.657247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.657588 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.658281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.661054 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.693011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1197/2434] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:28 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:28.697357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.716816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b263-ab88-4657-846f-48916f6c65c3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.826069 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.827342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.827820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.828267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.829424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.833942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.897598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.897748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1238/2435] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:28 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:28.913020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d70fd1-8891-40b3-82f8-952161a45f35 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.919026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.920335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.920335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.920335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.921735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.923216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.935937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1198/2436] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:28.940236 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.950690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8825007-3d3f-4c6f-8cf6-ad6dd729af95 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.954901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.957801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.960700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.961303 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.961582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.961856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.962505 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.965515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.981216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1239/2437] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:28.982110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.992782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736abd6a-26aa-4970-a746-91b59ba3ccf8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.997950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82422-93c2-4719-a9f1-fa267db8968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.999038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82422-93c2-4719-a9f1-fa267db8968b admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.999038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82422-93c2-4719-a9f1-fa267db8968b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.999380 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82422-93c2-4719-a9f1-fa267db8968b admin admin] PATH_INFO: `/v3/projects/e65013a051e740bdb50724f55b89283a/users/cf2603fd327f47a19c123a03cd5ba872/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.011792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:29.017301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82422-93c2-4719-a9f1-fa267db8968b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65013a051e740bdb50724f55b89283a, user_id=cf2603fd327f47a19c123a03cd5ba872, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.020615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82422-93c2-4719-a9f1-fa267db8968b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.037013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1240/2438] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:28 2022] PUT /identity/v3/projects/e65013a051e740bdb50724f55b89283a/users/cf2603fd327f47a19c123a03cd5ba872/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:29.051807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.052099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.052848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.067240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d902-8c19-4e8b-a64b-d0e195e3e75e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.069977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:29.090879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] MFA Rules not processed for user `cf2603fd327f47a19c123a03cd5ba872`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:29.092940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.144775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.145406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.145680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.145954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.148872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.163655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.165865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.175708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1241/2439] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:29.175708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.181033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1199/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:29.183522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.184775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.186224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.263064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d988ad-f727-4632-90e8-3da2304b72e6 service placement] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.266322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.266781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde7a2-2259-42df-962e-b01b5d7e4f24 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.267092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.267436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.267766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.271865 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.272491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.272801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.273080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] PATH_INFO: `/v3/users/72a30400dec14a85889af8d8dd59886e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.274212 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a30400dec14a85889af8d8dd59886e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.277015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.278499 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.279274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.287709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1200/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:29.290638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.291519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.305253 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c276-80ad-481a-a10e-d197948210c7 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.317373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.318291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.318710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.319226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] PATH_INFO: `/v3/users/381f8ca947954e01b6255626d4a2888f` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.320450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381f8ca947954e01b6255626d4a2888f)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.323099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.347586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a30400dec14a85889af8d8dd59886e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.355791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a30400dec14a85889af8d8dd59886e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.370314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a30400dec14a85889af8d8dd59886e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.383671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381f8ca947954e01b6255626d4a2888f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.386519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a30400dec14a85889af8d8dd59886e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.387426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a30400dec14a85889af8d8dd59886e'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.392529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381f8ca947954e01b6255626d4a2888f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.394751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1242/2442] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:29 2022] DELETE /identity/v3/users/72a30400dec14a85889af8d8dd59886e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:29.395780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.400039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.401120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:29.411248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381f8ca947954e01b6255626d4a2888f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.421807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381f8ca947954e01b6255626d4a2888f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.422721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381f8ca947954e01b6255626d4a2888f'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.433803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1201/2443] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:29 2022] DELETE /identity/v3/users/381f8ca947954e01b6255626d4a2888f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:29.434926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:29.490906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0cca-f8bb-4462-9738-6e499464a1ac admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.554567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.555404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.555790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.556172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] PATH_INFO: `/v3/users/cf2603fd327f47a19c123a03cd5ba872` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.557476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2603fd327f47a19c123a03cd5ba872)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.559599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.625497 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2603fd327f47a19c123a03cd5ba872'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.625755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.627294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.649988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923770a9-78fc-4afe-bf47-69f1a657ac83 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.655013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2603fd327f47a19c123a03cd5ba872'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.657528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.658145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.658440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.658736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] PATH_INFO: `/v3/projects/8299891a8d134af4be3f84cdc7abec51` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.660304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8299891a8d134af4be3f84cdc7abec51)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.662427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.668691 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2603fd327f47a19c123a03cd5ba872'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.687263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2603fd327f47a19c123a03cd5ba872'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.688025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2603fd327f47a19c123a03cd5ba872'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.695842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1243/2444] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:29 2022] DELETE /identity/v3/users/cf2603fd327f47a19c123a03cd5ba872 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:29.697110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.699015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.722851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8299891a8d134af4be3f84cdc7abec51', 'request_id': 'req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.729008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8299891a8d134af4be3f84cdc7abec51', 'request_id': 'req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.737252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8299891a8d134af4be3f84cdc7abec51', 'request_id': 'req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.748878 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] The token cache is being invalidate because project 8299891a8d134af4be3f84cdc7abec51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:29.749171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.749818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dc294f9d-9292-4a33-8649-cb2f66ce5bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.750890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:29.751343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1202/2445] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:29 2022] DELETE /identity/v3/projects/8299891a8d134af4be3f84cdc7abec51 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:29.754853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83cf8-bc04-4717-97eb-112270d2b9a3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.754853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83cf8-bc04-4717-97eb-112270d2b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.754853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83cf8-bc04-4717-97eb-112270d2b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.771981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d1b83cf8-bc04-4717-97eb-112270d2b9a3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:29.773107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d1b83cf8-bc04-4717-97eb-112270d2b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.778340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71234-00d6-4481-96b4-656a355aecaf admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.832769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1203/2446] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:29.834025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.834336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.834631 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.839745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.840395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.841410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.841692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] PATH_INFO: `/v3/projects/ecebdd96e25642468903a1657a8ee82d` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.842892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecebdd96e25642468903a1657a8ee82d)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:29.847627 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:29.859741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:29.861520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.873876 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1204/2447] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:29.875146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:29.876918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.905666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecebdd96e25642468903a1657a8ee82d', 'request_id': 'req-ea71e1b0-c759-413e-bee2-940c1e6039de'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.913562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecebdd96e25642468903a1657a8ee82d', 'request_id': 'req-ea71e1b0-c759-413e-bee2-940c1e6039de'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.922141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecebdd96e25642468903a1657a8ee82d', 'request_id': 'req-ea71e1b0-c759-413e-bee2-940c1e6039de'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.935504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] The token cache is being invalidate because project ecebdd96e25642468903a1657a8ee82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:29.935789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.936528 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-ea71e1b0-c759-413e-bee2-940c1e6039de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:29.938503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1244/2448] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:29 2022] DELETE /identity/v3/projects/ecebdd96e25642468903a1657a8ee82d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:29.939760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0f82-f258-4760-8db2-ab776861abcf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.940103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0f82-f258-4760-8db2-ab776861abcf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.940443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0f82-f258-4760-8db2-ab776861abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.940825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e1063-f73c-4954-96aa-baba7f68fa2c None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:29.948853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:29.960735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-46bb0f82-f258-4760-8db2-ab776861abcf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:29.962077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-46bb0f82-f258-4760-8db2-ab776861abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:29.990393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:29.991029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:29.991309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:29.991577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:29.993856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.023221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1245/2449] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:30.024387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.024820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.025103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.044026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.045225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.053730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1246/2450] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:30.054496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.059501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.060938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bac7d-343c-4465-8eab-eeadd48573a6 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.065230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6698b4e-7948-4e75-a74c-2a9966f396ec None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.070090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.070764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.071040 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.071316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.071543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1205/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:30.072038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:30.072420 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.072887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.073204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.073455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.074023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.083446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:30.087557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1247/2452] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:30.092008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.094484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.095726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.103823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706c3d-8ca0-4e3c-9ea2-84588e558190 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.105375 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1206/2453] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:30.109634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.111939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.112547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.112873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.113164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.113768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.115735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.119621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9717c3a-f9dd-4365-b718-cdaea067a91b None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.126531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.127069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.127369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.127614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.128396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:30.128751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.130343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.149830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1207/2454] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:56:30.150050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1248/2455] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:30.151075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.151253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.162204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3c3d-8ee1-4017-916c-70eee23a70b5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.223517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292818a-1a9c-4eaa-91ef-217534cd6cd3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.229265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.229898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.230215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.230456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.231029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.231208 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.232364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.232894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.233428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.234192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.235997 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.236466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.266135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1249/2456] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:30.270732 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.275295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1208/2457] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:30.276603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.281170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b85b-2727-4c97-83f8-89f5316043d4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.310758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:30.349250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5898-5900-423f-9f51-892d25776eed admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.353917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.354651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.355010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.355135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.355368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.355713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.356003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.356246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.356362 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.356893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.358052 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.358827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.370690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1250/2458] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:30.373395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.383839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a39cc-e1fd-4c00-8502-625395a67f15 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.387727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1209/2459] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/users => generated 279 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:30.389155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.391821 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.392526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.393027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.393357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.394584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.396412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.401649 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce542-a607-4b90-aa83-6436980de01c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.406805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.407423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.407707 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.407983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.408635 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.410838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.411574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1251/2460] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:30.415504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.425372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1210/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:30.426517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc295de9-99bc-4fa2-a360-3563ac617232 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.429323 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.432300 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae9f03-e3d5-473c-a505-06311edd3027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.432962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9f03-e3d5-473c-a505-06311edd3027 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.433242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9f03-e3d5-473c-a505-06311edd3027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.433522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9f03-e3d5-473c-a505-06311edd3027 admin admin] PATH_INFO: `/v3/projects/e863738007624fa99ac6178136dacd5b/users/551cb6754dad418280a3aa77d2c0e845/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.440070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125fd40-309b-4143-8272-192d578d5650 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.445616 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.446224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.446507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.446856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.447512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.449107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.449232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9f03-e3d5-473c-a505-06311edd3027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e863738007624fa99ac6178136dacd5b, user_id=551cb6754dad418280a3aa77d2c0e845, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.451820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9f03-e3d5-473c-a505-06311edd3027 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.461889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1211/2462] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:30.466898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.472687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1252/2463] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:30 2022] PUT /identity/v3/projects/e863738007624fa99ac6178136dacd5b/users/551cb6754dad418280a3aa77d2c0e845/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:30.481461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60169702-ae9f-41c8-be36-34547088ea6e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.482934 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.483325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.483607 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.512506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] MFA Rules not processed for user `551cb6754dad418280a3aa77d2c0e845`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.513741 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.531712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:30.557989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.558345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.558785 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.559393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] PATH_INFO: `/v3/projects/c118215d9c0c42a0a50fb90b1d6b6709/users/a4ae6e5c59fb486988b85241712ff12b/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.578739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c118215d9c0c42a0a50fb90b1d6b6709, user_id=a4ae6e5c59fb486988b85241712ff12b, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.582773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.592645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1253/2464] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:30.595978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.598726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.600874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1212/2465] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:30 2022] PUT /identity/v3/projects/c118215d9c0c42a0a50fb90b1d6b6709/users/a4ae6e5c59fb486988b85241712ff12b/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:30.604562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.606492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.617587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd03e2-fc9d-450e-bb20-45fd06b10ea6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.667627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beba11-838f-4df2-b8bd-3b2bc44adaa9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.671310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016fb0-1bc5-4533-a42b-75371bb8a7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.671916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016fb0-1bc5-4533-a42b-75371bb8a7eb service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.672225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016fb0-1bc5-4533-a42b-75371bb8a7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.672498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016fb0-1bc5-4533-a42b-75371bb8a7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.676134 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.676933 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.677216 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.677490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] PATH_INFO: `/v3/projects/e65013a051e740bdb50724f55b89283a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.679178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65013a051e740bdb50724f55b89283a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.681280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.707377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:30.730806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65013a051e740bdb50724f55b89283a', 'request_id': 'req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:30.736446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af016fb0-1bc5-4533-a42b-75371bb8a7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.737038 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65013a051e740bdb50724f55b89283a', 'request_id': 'req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:30.738113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af016fb0-1bc5-4533-a42b-75371bb8a7eb service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.743943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65013a051e740bdb50724f55b89283a', 'request_id': 'req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:30.748007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1213/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:30.749285 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.749630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.749902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.755373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] The token cache is being invalidate because project e65013a051e740bdb50724f55b89283a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:30.755661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:30.756324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-cd523d65-e60a-4d4b-97f5-f58dcfd6d003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:30.758127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1254/2467] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:30 2022] DELETE /identity/v3/projects/e65013a051e740bdb50724f55b89283a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:30.762472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1def-9136-42c1-be0e-5e00d17fbb32 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.762817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1def-9136-42c1-be0e-5e00d17fbb32 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.763125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed1def-9136-42c1-be0e-5e00d17fbb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.781524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] MFA Rules not processed for user `a4ae6e5c59fb486988b85241712ff12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.782682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.783708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-58ed1def-9136-42c1-be0e-5e00d17fbb32 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.784966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-58ed1def-9136-42c1-be0e-5e00d17fbb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.835824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:30.852127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1214/2468] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:30.857003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.858389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.858753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1255/2469] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:30.861617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.861904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.864455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.873885 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15574cab-94e3-4f74-8c75-56e5f3e920c3 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.879372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.879989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.880475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.880735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.881571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.883513 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.886325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.887541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.897845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1256/2470] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:30.902258 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.912014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d334b-bc75-46c5-989f-62ce9dca3edf None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.917206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:30.917831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.918141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.918414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.918761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1215/2471] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/projects => generated 355 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:30.919091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:30.919407 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:30.920995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:30.921590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.934292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1257/2472] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:30.939211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.951648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa234-c801-4674-bc06-be9a64719ec2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:30.998547 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee587f34-f92d-4de1-b9d4-3bad79486147 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.004470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.005096 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.005453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.005738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.006380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.008429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.014838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.015472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.015711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.015981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.016873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.019953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.034853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1216/2473] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:31.038851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.054917 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b1490-cd59-4b6c-b62f-2a78d9b4b6fd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.059429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1258/2474] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:31.061697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.062880 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.063150 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.063503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.064196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.064324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.067275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.086669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1217/2475] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:31.089453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.106656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad081a-7807-43af-b5f5-59ee5bb60d41 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.124181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:31.142571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94512f-5fc9-479c-a774-a42c9e7216e8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.147724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.148386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.148666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.148943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.149568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.152154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.174227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.174990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.175937 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.176252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1259/2476] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:31 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:31.176364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] PATH_INFO: `/v3/projects/9a8e4a85ff0047c6bfee4967df1b6944/users/445ca8fe2c354e5e8562542064caa6e7/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.180291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.190096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d9e9c-322e-4afc-b059-1e4da8961af4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.192607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8e4a85ff0047c6bfee4967df1b6944, user_id=445ca8fe2c354e5e8562542064caa6e7, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.195289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.195419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.195875 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.196153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.196426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.197065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.198676 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.208625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1218/2477] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:31 2022] PUT /identity/v3/projects/9a8e4a85ff0047c6bfee4967df1b6944/users/445ca8fe2c354e5e8562542064caa6e7/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:31.212010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1260/2478] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:31.212522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.212920 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.223030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358d69-7e40-43f5-a116-a4bae1bf1123 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.252743 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:31.278998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf6a4-160d-4e2b-a98d-d82f86bf74f9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.284449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.285158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.285378 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.285539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.285660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.286140 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.286265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.286423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.286735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.287373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.288699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.288948 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.302168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1261/2479] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:31.302364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1219/2480] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:31.303220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.303406 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.313451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a5e55-2605-47f2-b900-782224a64a28 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.319063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b578881-9851-4750-97ca-acd941d16538 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.320081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438d95e-a5a4-428f-ba5b-1d5cab28b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.320956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d95e-a5a4-428f-ba5b-1d5cab28b791 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.321342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d95e-a5a4-428f-ba5b-1d5cab28b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.321675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d95e-a5a4-428f-ba5b-1d5cab28b791 admin admin] PATH_INFO: `/v3/projects/9a8e4a85ff0047c6bfee4967df1b6944/users/445ca8fe2c354e5e8562542064caa6e7/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.323688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438d95e-a5a4-428f-ba5b-1d5cab28b791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8e4a85ff0047c6bfee4967df1b6944, user_id=445ca8fe2c354e5e8562542064caa6e7, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.324165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8989e59-cede-46dc-906d-a2a2d4c6320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.324810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8989e59-cede-46dc-906d-a2a2d4c6320c admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.325087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8989e59-cede-46dc-906d-a2a2d4c6320c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.325358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8989e59-cede-46dc-906d-a2a2d4c6320c admin admin] PATH_INFO: `/v3/projects/8c66a0584e9345c392d95524bdcc7f16/users/10ddb84a8b734c70b7b55685a1a12f95/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.326328 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438d95e-a5a4-428f-ba5b-1d5cab28b791 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.338747 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1220/2481] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:31 2022] PUT /identity/v3/projects/9a8e4a85ff0047c6bfee4967df1b6944/users/445ca8fe2c354e5e8562542064caa6e7/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:31.341118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8989e59-cede-46dc-906d-a2a2d4c6320c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c66a0584e9345c392d95524bdcc7f16, user_id=10ddb84a8b734c70b7b55685a1a12f95, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.343807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8989e59-cede-46dc-906d-a2a2d4c6320c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.350084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.350380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.350782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.357968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1262/2482] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:31 2022] PUT /identity/v3/projects/8c66a0584e9345c392d95524bdcc7f16/users/10ddb84a8b734c70b7b55685a1a12f95/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:31.363755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.364117 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.364397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.378836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] MFA Rules not processed for user `445ca8fe2c354e5e8562542064caa6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:31.380050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:31.382551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:31.383725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:31.441965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1263/2483] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:31.448940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1221/2484] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:31.451701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.453363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:31.461237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.462587 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:31.473381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:31.512672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7aa4-1731-4bcb-aea3-d44c564e2ebd None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.516605 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.517207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.517491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.517783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.523595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7728be-9ffa-4dfb-9c8b-4f749178e9f5 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.527637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568f411-51ec-42ec-b462-2e2a9510ff79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.528245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f411-51ec-42ec-b462-2e2a9510ff79 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.528531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f411-51ec-42ec-b462-2e2a9510ff79 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.528796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f411-51ec-42ec-b462-2e2a9510ff79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.529329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.530906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.538548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f411-51ec-42ec-b462-2e2a9510ff79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.539930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f411-51ec-42ec-b462-2e2a9510ff79 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.541037 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1264/2485] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:31.549688 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1222/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:31.631796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:31.643184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97a04d-bb20-415f-93c6-7ac24dfc2ebb service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.647231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.647823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.648118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.648370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.696502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:31.711587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.713179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.723026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1265/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:32.256675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4331c-4cc0-48bc-9e9e-36a56ef7db94 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:32.256963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4331c-4cc0-48bc-9e9e-36a56ef7db94 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:32.257234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4331c-4cc0-48bc-9e9e-36a56ef7db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:32.287537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-07b4331c-4cc0-48bc-9e9e-36a56ef7db94 None None] MFA Rules not processed for user `10ddb84a8b734c70b7b55685a1a12f95`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:32.289433 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-07b4331c-4cc0-48bc-9e9e-36a56ef7db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:32.365665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1223/2488] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:32.376697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:32.378162 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:32.391897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5059a84-7923-47ef-bfaf-4336f1dfac8f service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:32.396329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:32.396935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:32.397217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:32.397520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:32.406790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:32.408368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:32.418921 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1266/2489] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:33.791648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:33.792140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:33.792224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:33.811098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] MFA Rules not processed for user `10ddb84a8b734c70b7b55685a1a12f95`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:33.812543 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:33.820013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1224/2490] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:34.069011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:34.078360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b6703-032e-454e-9e2a-a0860059a97a service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:34.081985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:34.082571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:34.082879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:34.083176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:34.084849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:34.094636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:34.096116 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78354be-0693-4cf3-86a6-e17b858665a4 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:34.104375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1267/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:39.333964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:39.335464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.349581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a801e7-37ae-437c-897c-853dd0b66f27 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:39.354111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:39.354777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.355060 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.355331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] PATH_INFO: `/v3/users/551cb6754dad418280a3aa77d2c0e845` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.356465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=551cb6754dad418280a3aa77d2c0e845)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:39.358360 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:39.405158 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551cb6754dad418280a3aa77d2c0e845'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.412345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551cb6754dad418280a3aa77d2c0e845'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.423820 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551cb6754dad418280a3aa77d2c0e845'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.430426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551cb6754dad418280a3aa77d2c0e845'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.431083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551cb6754dad418280a3aa77d2c0e845'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.436770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1225/2492] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:39 2022] DELETE /identity/v3/users/551cb6754dad418280a3aa77d2c0e845 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:39.441462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.441925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.442076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.460841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:39.462011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.517684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1268/2493] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:39.527828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:39.529245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.539344 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:39.589318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed30f29-71b7-43ee-82bd-6e2cdfc45acd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:39.592859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef5656-30dc-48a4-9389-42ec6a62320e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:39.593458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5656-30dc-48a4-9389-42ec6a62320e service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.593735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5656-30dc-48a4-9389-42ec6a62320e service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.594007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5656-30dc-48a4-9389-42ec6a62320e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.602868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef5656-30dc-48a4-9389-42ec6a62320e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:39.604282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef5656-30dc-48a4-9389-42ec6a62320e service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:39.613602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1226/2494] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:39.899405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:39.900899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.914930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b36c7-641f-4876-85b9-2e5dc93b1fd6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:39.920185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:39.920816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.921094 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.921366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] PATH_INFO: `/v3/projects/e863738007624fa99ac6178136dacd5b` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.922630 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e863738007624fa99ac6178136dacd5b)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:39.924672 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:39.977939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e863738007624fa99ac6178136dacd5b', 'request_id': 'req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.984090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e863738007624fa99ac6178136dacd5b', 'request_id': 'req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:39.992809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e863738007624fa99ac6178136dacd5b', 'request_id': 'req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:40.005203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] The token cache is being invalidate because project e863738007624fa99ac6178136dacd5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:40.005603 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:40.006354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-88a47bfd-5f06-4bd2-a0e9-22a6bd2e11d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:40.008449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1269/2495] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:39 2022] DELETE /identity/v3/projects/e863738007624fa99ac6178136dacd5b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:40.013463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.013750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.014027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.034544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:40.035850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:40.122865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1227/2496] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:40.125567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.125866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.126205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.147733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:40.149076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:40.157516 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1270/2497] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:40.162296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.171967 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711ec1-119b-4fa7-b5d8-9d1d18acee98 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.177110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.177699 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.177973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.178317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.178927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:40.179224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.180843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.193832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1228/2498] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:40.198371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.211504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc44c5c-b6b1-44f5-bfea-6d1f6d8ba3fe None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.216179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.216774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.217055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.217334 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.218164 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.220198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.250639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1271/2499] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:40.252540 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.262829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5037-4a28-4b5d-9b51-f3959b37507a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.320548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.321261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.321548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.321851 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.322484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.324445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.345721 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1229/2500] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:40.350328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.360959 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002cb0d-288d-4f0f-adf4-be422cfde6e5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.366237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.366884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.367159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.367427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.368061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.369650 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.379525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1272/2501] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:40.383612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.393767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca140-3944-4285-9f4e-ed57c61a2d50 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.400762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34f2b7-6602-4059-a1b6-ef031ffb027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.401358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34f2b7-6602-4059-a1b6-ef031ffb027f admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.401638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34f2b7-6602-4059-a1b6-ef031ffb027f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.401930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34f2b7-6602-4059-a1b6-ef031ffb027f admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.402549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34f2b7-6602-4059-a1b6-ef031ffb027f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.404154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34f2b7-6602-4059-a1b6-ef031ffb027f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.415276 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1230/2502] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:40.419695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.427158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:40.431154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d63ae-018e-42b1-8f26-f65fdaef1a1d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.436714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.437801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.438262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.438597 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] PATH_INFO: `/v3/projects/d8a435f0af4045d8be1106230ff8ca54/users/f25ab18288234cd2992b8feb4bde6f0b/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.453312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a435f0af4045d8be1106230ff8ca54, user_id=f25ab18288234cd2992b8feb4bde6f0b, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.456028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.469176 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1273/2503] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:40 2022] PUT /identity/v3/projects/d8a435f0af4045d8be1106230ff8ca54/users/f25ab18288234cd2992b8feb4bde6f0b/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:40.480086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.480380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.480657 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.508099 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] MFA Rules not processed for user `f25ab18288234cd2992b8feb4bde6f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:40.509293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:40.513471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:40.574343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1231/2504] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:40.578856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.641417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9910fe-b1b9-4a1c-9b9c-4131ae798b4d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.646599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.647229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.647512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.647787 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.648409 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.650324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.676937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1274/2505] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:40.681070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.692420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb88ce-2285-4eaf-8dd0-2949a9d194ba None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.748446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.749040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.749319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.749594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.750201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.752127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.772447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1232/2506] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:40.776453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.787226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb717fdb-f880-4a3c-821e-40f398f6058f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.791898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.792482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.792755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.793022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.793685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.795325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.805551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1275/2507] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:40.809404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.819612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade840-3878-4b11-9077-55bfe93331f4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.824308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.824993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.825223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.825494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] PATH_INFO: `/v3/projects/129b3267662d4deb9dcb165c9fd90245/users/db4192a57ba94196899063f79b9b7809/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.840418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=129b3267662d4deb9dcb165c9fd90245, user_id=db4192a57ba94196899063f79b9b7809, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.843071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.855560 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1233/2508] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:40 2022] PUT /identity/v3/projects/129b3267662d4deb9dcb165c9fd90245/users/db4192a57ba94196899063f79b9b7809/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:40.859535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.869453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0271e4-5255-4464-8ce3-4640dd536678 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.923716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805bebd-78b7-41ed-8f5b-484d8b05627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.924315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805bebd-78b7-41ed-8f5b-484d8b05627d admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.924593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805bebd-78b7-41ed-8f5b-484d8b05627d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.924864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805bebd-78b7-41ed-8f5b-484d8b05627d admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.925499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805bebd-78b7-41ed-8f5b-484d8b05627d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.927125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805bebd-78b7-41ed-8f5b-484d8b05627d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.936575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1276/2509] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:40.941091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:40.951300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582a63-91a0-4aa0-ab7c-a377e0ad1a8e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:40.956006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:40.957142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.957422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.957702 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] PATH_INFO: `/v3/projects/129b3267662d4deb9dcb165c9fd90245/users/db4192a57ba94196899063f79b9b7809/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:40.959627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129b3267662d4deb9dcb165c9fd90245, user_id=db4192a57ba94196899063f79b9b7809, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:40.962246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:40.972265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1234/2510] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:40 2022] PUT /identity/v3/projects/129b3267662d4deb9dcb165c9fd90245/users/db4192a57ba94196899063f79b9b7809/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:40.982307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:40.982595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:40.982901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:41.009517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] MFA Rules not processed for user `db4192a57ba94196899063f79b9b7809`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:41.010727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:41.050655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:41.079448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1277/2511] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:41.090903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:41.092576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:41.148079 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe80ca-e45f-49c5-bead-26b727c29ef8 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:41.151662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:41.152248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:41.152525 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:41.152797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:41.162034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:41.163198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:41.168215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:41.173321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1235/2512] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:41.261701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:41.274554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cd08-2ff8-46ad-b2a9-bb5cc644f647 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:41.278307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85baef-c3a0-4d07-802b-aad6a6b4deac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:41.278950 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85baef-c3a0-4d07-802b-aad6a6b4deac service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:41.279229 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85baef-c3a0-4d07-802b-aad6a6b4deac service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:41.279499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85baef-c3a0-4d07-802b-aad6a6b4deac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:41.355328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85baef-c3a0-4d07-802b-aad6a6b4deac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:41.356979 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85baef-c3a0-4d07-802b-aad6a6b4deac service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:41.367973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1278/2513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:45.645881 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:45.714240 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3e93-dc03-4b0e-9756-c9c942781a27 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:45.718942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:45.719567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:45.719848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:45.720122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] PATH_INFO: `/v3/users/f25ab18288234cd2992b8feb4bde6f0b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:45.721270 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25ab18288234cd2992b8feb4bde6f0b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:45.723712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:45.773294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25ab18288234cd2992b8feb4bde6f0b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:45.782109 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25ab18288234cd2992b8feb4bde6f0b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:45.795691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25ab18288234cd2992b8feb4bde6f0b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:45.805790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25ab18288234cd2992b8feb4bde6f0b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:45.806523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25ab18288234cd2992b8feb4bde6f0b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:45.813048 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1236/2514] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:45 2022] DELETE /identity/v3/users/f25ab18288234cd2992b8feb4bde6f0b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:45.817522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:45.818275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:45.818275 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:45.838328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:45.839587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:45.919110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1279/2515] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:45.928839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:45.930335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:45.989818 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f05c-29e6-4190-81e6-95310f833fe0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:45.993891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:45.994665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:45.994950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:45.995224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:46.004741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:46.006217 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:46.019935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1237/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:46.298991 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:46.300474 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:46.321241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb81ee-9162-4bb4-b4db-bcdced9b5a8f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:46.327123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:46.327802 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:46.328157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:46.328434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] PATH_INFO: `/v3/projects/d8a435f0af4045d8be1106230ff8ca54` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:46.329580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a435f0af4045d8be1106230ff8ca54)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:46.332188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:46.377004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a435f0af4045d8be1106230ff8ca54', 'request_id': 'req-3ace9da2-74f9-4ba8-ad99-0944541f33a3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.384853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a435f0af4045d8be1106230ff8ca54', 'request_id': 'req-3ace9da2-74f9-4ba8-ad99-0944541f33a3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.392118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a435f0af4045d8be1106230ff8ca54', 'request_id': 'req-3ace9da2-74f9-4ba8-ad99-0944541f33a3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.399370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:46.404382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] The token cache is being invalidate because project d8a435f0af4045d8be1106230ff8ca54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:46.405203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.406118 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.407976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1280/2517] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:46 2022] DELETE /identity/v3/projects/d8a435f0af4045d8be1106230ff8ca54 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:46.411931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:46.421569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab364ddc-28a2-4f2f-bcc9-dc954785a60f service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:46.439319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:46.481275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:46.481957 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:46.482244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:46.482515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] PATH_INFO: `/v3/users/db4192a57ba94196899063f79b9b7809` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:46.483697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4192a57ba94196899063f79b9b7809)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:46.485589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:46.545454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4192a57ba94196899063f79b9b7809'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.552365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4192a57ba94196899063f79b9b7809'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.564452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4192a57ba94196899063f79b9b7809'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.571873 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4192a57ba94196899063f79b9b7809'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.572586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4192a57ba94196899063f79b9b7809'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:46.584567 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1238/2518] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:46 2022] DELETE /identity/v3/users/db4192a57ba94196899063f79b9b7809 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:46.887669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:46.889122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:46.903826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9da2-74f9-4ba8-ad99-0944541f33a3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:46.974545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:46.975249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:46.975531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:46.975806 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] PATH_INFO: `/v3/projects/129b3267662d4deb9dcb165c9fd90245` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:46.976923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=129b3267662d4deb9dcb165c9fd90245)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:46.978993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:46.984386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:46.986146 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.000455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb0e0-7c74-4f86-a516-ca87f1b6cef8 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.005043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.005665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.005947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.006223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] PATH_INFO: `/v3/users/a4ae6e5c59fb486988b85241712ff12b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.007452 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ae6e5c59fb486988b85241712ff12b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.009446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.029419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129b3267662d4deb9dcb165c9fd90245', 'request_id': 'req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.036312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129b3267662d4deb9dcb165c9fd90245', 'request_id': 'req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.049198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129b3267662d4deb9dcb165c9fd90245', 'request_id': 'req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.066659 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ae6e5c59fb486988b85241712ff12b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.066986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] The token cache is being invalidate because project 129b3267662d4deb9dcb165c9fd90245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:47.067327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.068101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c636d2fa-7e1d-42b6-8b72-e4764e393a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.070320 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1281/2519] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:46 2022] DELETE /identity/v3/projects/129b3267662d4deb9dcb165c9fd90245 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:47.075218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649466-19ad-4de9-bb1e-3f343718a458 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.075512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649466-19ad-4de9-bb1e-3f343718a458 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.075895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649466-19ad-4de9-bb1e-3f343718a458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.077748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ae6e5c59fb486988b85241712ff12b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.092732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ae6e5c59fb486988b85241712ff12b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.100714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a0649466-19ad-4de9-bb1e-3f343718a458 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:47.101935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a0649466-19ad-4de9-bb1e-3f343718a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.103170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ae6e5c59fb486988b85241712ff12b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.104371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-13f7b36f-2f95-4f0f-8733-6257cd035a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ae6e5c59fb486988b85241712ff12b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:47.114739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1239/2520] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:46 2022] DELETE /identity/v3/users/a4ae6e5c59fb486988b85241712ff12b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:47.116765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.117123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.117467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.139756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:47.141014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.152184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.179235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1282/2521] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:47.186716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.187010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.187536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.212310 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:47.214059 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.222833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1240/2522] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:47.226635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1283/2523] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:47.230215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.230488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.231791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.240254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6eed-b99a-48ab-92de-42b497872d90 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.246150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.246953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.247399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.247830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.248623 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:47.249072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.250904 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.263146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1284/2524] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:56:47.269436 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.278958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7892430-1a79-4e48-beab-06f39bc6c341 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.283681 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.284282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.284566 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.284838 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.285444 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.287610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.293447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7c6f-e632-49f5-af5a-caf8537bb5fc None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.296853 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.297243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.297875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.298157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.298437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.309992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.311464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.327177 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1285/2525] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:47.327354 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1241/2526] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:47.331265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.396943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ccb6d-4aa4-40ea-8a5f-e5b91fa8fb9f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.403465 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.404287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.404567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.404839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.405463 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.407434 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.432967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1286/2527] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:47.434204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.445283 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a33da-3fd2-4f24-9a03-06cf4ec2a0cd service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.450119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.450742 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.451023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.451295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.451933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.453526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.464898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1242/2528] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:47.468712 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.478850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f430-be5d-4736-a338-609c64448960 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.484133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf45c7c-0499-40f4-93e0-c255d900d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.484916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf45c7c-0499-40f4-93e0-c255d900d9ed admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.485183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf45c7c-0499-40f4-93e0-c255d900d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.485455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf45c7c-0499-40f4-93e0-c255d900d9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.486111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf45c7c-0499-40f4-93e0-c255d900d9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.488271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf45c7c-0499-40f4-93e0-c255d900d9ed admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.500872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1287/2529] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:47.505813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.516157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd2cdb-25d7-4d62-8be5-d11e7786c13e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.520815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.521624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.521906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.522178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] PATH_INFO: `/v3/projects/bbf8f102190c41888faa323d0ce34fc8/users/2ffed17e5d9e4ed6b36adc9c0f5751a0/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.537586 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf8f102190c41888faa323d0ce34fc8, user_id=2ffed17e5d9e4ed6b36adc9c0f5751a0, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.540320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.560209 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1243/2530] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:47 2022] PUT /identity/v3/projects/bbf8f102190c41888faa323d0ce34fc8/users/2ffed17e5d9e4ed6b36adc9c0f5751a0/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:47.572109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.572776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.573299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.606379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] MFA Rules not processed for user `2ffed17e5d9e4ed6b36adc9c0f5751a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:47.607605 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.688906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1288/2531] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:47.693529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.762471 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cca5e5-4751-48b6-8be6-e917afa88cce admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.768562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.769823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.770203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.770572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.771413 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.773541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.805578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.807250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.808175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1244/2532] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:47.812017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.827390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.850492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f2b09-8b3d-43e1-b291-d642a15cdb9c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.919564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41dc38-49fc-422c-81a8-e7f680627a8d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.924703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.925859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.926172 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.926442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.927111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.929025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.929957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.939424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.941223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.941223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.941454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] PATH_INFO: `/v3/projects/c118215d9c0c42a0a50fb90b1d6b6709` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.943372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c118215d9c0c42a0a50fb90b1d6b6709)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.945481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.959944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1245/2533] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:47.961078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.973264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519691e-5416-4ff1-9a51-164471e2018b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.979088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.980026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.980501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.980963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.981836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:47.983860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:47.999391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1246/2534] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:48.000417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:48.012001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f052ab-13ed-4884-84c8-18484d2c28ee admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:48.013314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c118215d9c0c42a0a50fb90b1d6b6709', 'request_id': 'req-11b31769-7417-400a-be40-f470fa641e34'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.022572 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c118215d9c0c42a0a50fb90b1d6b6709', 'request_id': 'req-11b31769-7417-400a-be40-f470fa641e34'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.038278 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c118215d9c0c42a0a50fb90b1d6b6709', 'request_id': 'req-11b31769-7417-400a-be40-f470fa641e34'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.053506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] The token cache is being invalidate because project c118215d9c0c42a0a50fb90b1d6b6709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:48.053848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.059456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.062411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1289/2535] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:47 2022] DELETE /identity/v3/projects/c118215d9c0c42a0a50fb90b1d6b6709 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:48.067621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:48.070917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:48.113934 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:48.114668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:48.114979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:48.115255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] PATH_INFO: `/v3/projects/be9348efa6c946d89b9197cbd9b95da5/users/84bc3071974240539483349373260d0b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:48.133129 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9348efa6c946d89b9197cbd9b95da5, user_id=84bc3071974240539483349373260d0b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:48.135979 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:48.154459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31769-7417-400a-be40-f470fa641e34 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:48.155484 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1247/2536] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:47 2022] PUT /identity/v3/projects/be9348efa6c946d89b9197cbd9b95da5/users/84bc3071974240539483349373260d0b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:48.158996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:48.160745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:48.226760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:48.227471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:48.227858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:48.228446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] PATH_INFO: `/v3/users/445ca8fe2c354e5e8562542064caa6e7` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:48.229862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445ca8fe2c354e5e8562542064caa6e7)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:48.231946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:48.264677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90e1f4-5363-4b53-a877-4bc19ac2fe0b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:48.269816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:48.271143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:48.271512 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:48.271787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:48.273168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:48.275038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:48.287367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1248/2537] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:48.292318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:48.298874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:48.303386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:48.305334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf535-118c-4a15-97f6-ccc8b2f4731e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:48.313985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9a7af-3e9f-4093-ae7f-de580ef740b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:48.314927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a7af-3e9f-4093-ae7f-de580ef740b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:48.315210 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a7af-3e9f-4093-ae7f-de580ef740b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:48.315593 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9a7af-3e9f-4093-ae7f-de580ef740b6 admin admin] PATH_INFO: `/v3/projects/be9348efa6c946d89b9197cbd9b95da5/users/84bc3071974240539483349373260d0b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:48.319526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a7af-3e9f-4093-ae7f-de580ef740b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9348efa6c946d89b9197cbd9b95da5, user_id=84bc3071974240539483349373260d0b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:48.322091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9a7af-3e9f-4093-ae7f-de580ef740b6 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:48.328635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445ca8fe2c354e5e8562542064caa6e7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.336321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1249/2538] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:48 2022] PUT /identity/v3/projects/be9348efa6c946d89b9197cbd9b95da5/users/84bc3071974240539483349373260d0b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:48.342595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445ca8fe2c354e5e8562542064caa6e7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.347890 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:48.348171 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:48.348442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:48.357295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445ca8fe2c354e5e8562542064caa6e7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.381678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445ca8fe2c354e5e8562542064caa6e7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.382770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445ca8fe2c354e5e8562542064caa6e7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:48.382965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] MFA Rules not processed for user `84bc3071974240539483349373260d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:48.384184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:48.397518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1290/2539] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:48 2022] DELETE /identity/v3/users/445ca8fe2c354e5e8562542064caa6e7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:48.484526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1250/2540] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:48.497455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:48.499631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:48.617543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6810310-1c46-4a2b-9810-79e5942d5a85 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:48.621618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5024de-e039-451b-a318-bae54769ee13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:48.622244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5024de-e039-451b-a318-bae54769ee13 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:48.622720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5024de-e039-451b-a318-bae54769ee13 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:48.623018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5024de-e039-451b-a318-bae54769ee13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:48.765927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5024de-e039-451b-a318-bae54769ee13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:48.767508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5024de-e039-451b-a318-bae54769ee13 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:48.778731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1291/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:48.850571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:48.852282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:48.981860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3baf2-e14a-445d-9e45-83a091a4d50d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.068812 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.069507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.069862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.070072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] PATH_INFO: `/v3/projects/9a8e4a85ff0047c6bfee4967df1b6944` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.071334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8e4a85ff0047c6bfee4967df1b6944)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.073625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.119969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:49.143053 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8e4a85ff0047c6bfee4967df1b6944', 'request_id': 'req-2a213251-bd9b-498d-bf80-88619fc3ccb0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.150345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8e4a85ff0047c6bfee4967df1b6944', 'request_id': 'req-2a213251-bd9b-498d-bf80-88619fc3ccb0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.159924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8e4a85ff0047c6bfee4967df1b6944', 'request_id': 'req-2a213251-bd9b-498d-bf80-88619fc3ccb0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.172859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] The token cache is being invalidate because project 9a8e4a85ff0047c6bfee4967df1b6944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:49.173225 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.173828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2a213251-bd9b-498d-bf80-88619fc3ccb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.175969 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1251/2542] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:48 2022] DELETE /identity/v3/projects/9a8e4a85ff0047c6bfee4967df1b6944 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:49.180961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.181464 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.181697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.208915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:49.210375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:49.302754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1292/2543] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:49.306872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.307167 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.307449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.332063 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:49.334800 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:49.348009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1252/2544] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:49.349316 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.356765 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:49.364791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8b459-5c09-4786-8052-d57af08a9a25 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.373496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.374749 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.375431 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.375938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.377231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:49.377673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.379652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.404867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1293/2545] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:49.409804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.434933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed1106-02b7-4fc7-8f00-f30d245d32d7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.452232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.453221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.453694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.454131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.455214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.458068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.520376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1253/2546] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:49.521425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.534461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07594a-e214-4554-98c5-a729a29dc6c3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.540989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.543780 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:49.622862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.623555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.623840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.624114 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.624869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.627005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.645027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b045-e968-40b6-9526-616fd545966b admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.654827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.655404 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.655690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.655965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] PATH_INFO: `/v3/users/2ffed17e5d9e4ed6b36adc9c0f5751a0` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.657230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffed17e5d9e4ed6b36adc9c0f5751a0)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.659256 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.666371 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1294/2547] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:49.670421 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.682265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d28ff-86f9-4caf-8160-fe96088968d6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.692678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.693179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.693646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.694010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.695217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.696633 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.718370 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1295/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:49.721973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.736972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27716-b5b6-4662-bf16-983f218b1fb4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.749992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.750727 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.751078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.751428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.752155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.754482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.779396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1296/2549] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:49.784222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.793374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffed17e5d9e4ed6b36adc9c0f5751a0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.803225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11001d28-a3c3-492a-bd23-d320582acbcf admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:49.818849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2a230-3923-436c-aa5a-b1ec631c0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:49.818849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2a230-3923-436c-aa5a-b1ec631c0a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.818849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2a230-3923-436c-aa5a-b1ec631c0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.818849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2a230-3923-436c-aa5a-b1ec631c0a3b admin admin] PATH_INFO: `/v3/projects/245512d612b24c478272a2b7a373ef78/users/1537d48c9e7146f58c97b16950853b5d/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.819419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffed17e5d9e4ed6b36adc9c0f5751a0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.829989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffed17e5d9e4ed6b36adc9c0f5751a0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.832901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2a230-3923-436c-aa5a-b1ec631c0a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=245512d612b24c478272a2b7a373ef78, user_id=1537d48c9e7146f58c97b16950853b5d, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:49.836955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2a230-3923-436c-aa5a-b1ec631c0a3b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:49.841058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffed17e5d9e4ed6b36adc9c0f5751a0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.841931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5dbe365e-71d3-4817-8b0c-08b7d567f8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffed17e5d9e4ed6b36adc9c0f5751a0'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:49.855599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1297/2551] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:49 2022] PUT /identity/v3/projects/245512d612b24c478272a2b7a373ef78/users/1537d48c9e7146f58c97b16950853b5d/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:49.865162 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1254/2551] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:49 2022] DELETE /identity/v3/users/2ffed17e5d9e4ed6b36adc9c0f5751a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:49.865302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.865302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.865302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.877241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.877630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.878069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.883034 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:49.884247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:49.887264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:49.922504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] MFA Rules not processed for user `1537d48c9e7146f58c97b16950853b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:49.923993 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:49.956902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1298/2552] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:49.967192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:49.969100 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.016596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1255/2553] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:50.021488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.023119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.025881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:50.047676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de1e8-bbb2-4bee-bb30-dcaef592b20d None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.053838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.054016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb8db-e832-46ee-b7bd-f342af5dc34c None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.054517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.054942 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.055205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.055877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.057796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.058138 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.058560 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.058956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.059307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.071540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.073001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.092399 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1299/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:50.105056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.107933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1256/2555] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:50 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:50.115744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18063-f288-47c0-867c-c65eccdf0941 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.192410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.193109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.193890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.193890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.194580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.203366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.226777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1300/2556] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:50 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:50.230844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.246491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5b12-4f4e-47ad-b517-33ed0d766bb9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.255145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.255914 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.256313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.256683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.257429 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.259686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.276924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1257/2557] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:50.281482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.294590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530fd6-54ed-4219-a149-e0aa705a14dc admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.307668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.308423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.308636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.312642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] PATH_INFO: `/v3/projects/348c04c7cc304b19b49d4dbc9bb7bf4e/users/6fc35bf198944e289c6c2bddaf11c97e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.332793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348c04c7cc304b19b49d4dbc9bb7bf4e, user_id=6fc35bf198944e289c6c2bddaf11c97e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.336017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.353651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1301/2558] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:50 2022] PUT /identity/v3/projects/348c04c7cc304b19b49d4dbc9bb7bf4e/users/6fc35bf198944e289c6c2bddaf11c97e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:50.359868 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.370542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8965-5380-48c3-a4bc-fba258e77abd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.428128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.430738 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.469697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.472736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.473200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.473492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.474142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.476652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.488639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1258/2559] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:50.492677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.504098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d3b91-bd86-40e4-b3f2-35e0bdd43292 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.509078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd0c0b-b716-464d-a682-af2b9c180439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.509968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd0c0b-b716-464d-a682-af2b9c180439 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.510245 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd0c0b-b716-464d-a682-af2b9c180439 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.510518 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd0c0b-b716-464d-a682-af2b9c180439 admin admin] PATH_INFO: `/v3/projects/348c04c7cc304b19b49d4dbc9bb7bf4e/users/6fc35bf198944e289c6c2bddaf11c97e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.512490 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd0c0b-b716-464d-a682-af2b9c180439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348c04c7cc304b19b49d4dbc9bb7bf4e, user_id=6fc35bf198944e289c6c2bddaf11c97e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.512811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567698-a2fd-4eb5-b5cf-2b7ca78fc590 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.515177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd0c0b-b716-464d-a682-af2b9c180439 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.517626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.518318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.519240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.519591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] PATH_INFO: `/v3/projects/bbf8f102190c41888faa323d0ce34fc8` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.520735 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf8f102190c41888faa323d0ce34fc8)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.522683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.527371 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1259/2560] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:50 2022] PUT /identity/v3/projects/348c04c7cc304b19b49d4dbc9bb7bf4e/users/6fc35bf198944e289c6c2bddaf11c97e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:50.538387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.538787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.539132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.566932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] MFA Rules not processed for user `6fc35bf198944e289c6c2bddaf11c97e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:50.568133 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.568888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:50.573017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf8f102190c41888faa323d0ce34fc8', 'request_id': 'req-0adaf20d-f107-4445-877a-a8fd5387ac33'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.580160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf8f102190c41888faa323d0ce34fc8', 'request_id': 'req-0adaf20d-f107-4445-877a-a8fd5387ac33'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.589869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf8f102190c41888faa323d0ce34fc8', 'request_id': 'req-0adaf20d-f107-4445-877a-a8fd5387ac33'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.604271 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:50.612121 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] The token cache is being invalidate because project bbf8f102190c41888faa323d0ce34fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:50.612445 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.613242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.614768 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1302/2561] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:50 2022] DELETE /identity/v3/projects/bbf8f102190c41888faa323d0ce34fc8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:50.618536 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.619874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.645238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1260/2562] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:50.656211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.657651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.690341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaf20d-f107-4445-877a-a8fd5387ac33 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.695190 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.695822 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.696111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.696388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] PATH_INFO: `/v3/users/84bc3071974240539483349373260d0b` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.697531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bc3071974240539483349373260d0b)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.699515 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.715943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54b904-4a57-458f-bf55-275cfbd79899 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.719708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.720317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.720597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.720923 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.733086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.735267 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.746258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1261/2563] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:50.750351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bc3071974240539483349373260d0b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.759604 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bc3071974240539483349373260d0b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.768411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bc3071974240539483349373260d0b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.785026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bc3071974240539483349373260d0b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.785791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0ef7f441-108c-479b-82ec-525f92450579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bc3071974240539483349373260d0b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:50.798133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1303/2564] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:50 2022] DELETE /identity/v3/users/84bc3071974240539483349373260d0b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:51.100091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.117985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04847f7a-daa8-478f-bdcb-8d6e1724fbc4 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.184692 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.185332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.185615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.185896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] PATH_INFO: `/v3/projects/be9348efa6c946d89b9197cbd9b95da5` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.187073 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9348efa6c946d89b9197cbd9b95da5)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.189319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.249903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9348efa6c946d89b9197cbd9b95da5', 'request_id': 'req-346e0e43-3e2f-45cd-911b-eb99cfe71489'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:51.257111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9348efa6c946d89b9197cbd9b95da5', 'request_id': 'req-346e0e43-3e2f-45cd-911b-eb99cfe71489'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:51.268329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9348efa6c946d89b9197cbd9b95da5', 'request_id': 'req-346e0e43-3e2f-45cd-911b-eb99cfe71489'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:51.281263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] The token cache is being invalidate because project be9348efa6c946d89b9197cbd9b95da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:51.281683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:51.282224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-346e0e43-3e2f-45cd-911b-eb99cfe71489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:51.283731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1262/2565] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:51 2022] DELETE /identity/v3/projects/be9348efa6c946d89b9197cbd9b95da5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:51.288970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.289432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.289680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.310796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:51.311998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:51.360923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:51.377338 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1304/2566] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:51.385000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.385361 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.385604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.394249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:51.412469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:51.414358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:51.422939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1263/2567] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:51.427595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.440256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf6e92-6dc7-49b2-bcea-f18743af8b88 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.446197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.447007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.447612 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.448214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.449585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:51.450210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.453439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.473808 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1305/2568] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:51.478234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.489864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee601-0f66-4353-82dc-9031426cebef None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.495316 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.496365 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.496530 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.496845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.497515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.499629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.544725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1264/2569] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:51 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:51.549960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.560160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a9eab-139e-4151-a19c-c3da713fa6d6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.638425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.640613 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.640981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.641427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.646110 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.647360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.680801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1306/2570] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:51 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:51.681531 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.696684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9fb2-243d-42c1-8d59-c2026e5f8a05 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.702128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.703036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.704140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.704140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.704342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.706074 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.722379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1265/2571] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:51.726726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.738563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64704005-ac58-4c0c-8b47-7c67aba26102 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.748545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00e37-7b93-4380-a417-39dac2022906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.749234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00e37-7b93-4380-a417-39dac2022906 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.749520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00e37-7b93-4380-a417-39dac2022906 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.749840 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00e37-7b93-4380-a417-39dac2022906 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.750558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00e37-7b93-4380-a417-39dac2022906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.752286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00e37-7b93-4380-a417-39dac2022906 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.763846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1307/2572] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:51.767985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:51.778462 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a863fb-88b9-4462-afd6-69109c71e087 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:51.783802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:51.784604 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.784912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.785190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] PATH_INFO: `/v3/projects/87bbce9e77494b81badc539d9117beed/users/ef4892f15fbf4524a50708080fa38218/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.803368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bbce9e77494b81badc539d9117beed, user_id=ef4892f15fbf4524a50708080fa38218, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:51.806056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:51.825286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1266/2573] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:51 2022] PUT /identity/v3/projects/87bbce9e77494b81badc539d9117beed/users/ef4892f15fbf4524a50708080fa38218/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:51.837324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:51.837880 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:51.838252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:51.873837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] MFA Rules not processed for user `ef4892f15fbf4524a50708080fa38218`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:51.875283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:51.955976 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1308/2574] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:51.961136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.032521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca862d-b806-4065-92a0-aad072948740 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.039390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.040024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.040298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.040580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.041203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.043367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.075386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1267/2575] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:51 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:52.079457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.090744 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2196bb-b8f6-4315-b395-32375ae7728a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.147769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:52.167282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.168008 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.169315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.169668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.170413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.173240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.198393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1309/2576] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:52 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:52.203748 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.217965 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9936d3-b70c-477a-98c0-544ca02efbb6 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.227264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.228084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.228455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.228938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.229603 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.231334 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.242673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1268/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:52.246770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.259141 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dd04d-26e8-4a65-9f2c-528582a9c56c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.263861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.264530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.264794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.265067 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] PATH_INFO: `/v3/projects/d25b314c43254d1dbb5c299e06ef0ed8/users/ce8d0e3d8e5b44d3ad8247e0a8ce5625/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.283019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25b314c43254d1dbb5c299e06ef0ed8, user_id=ce8d0e3d8e5b44d3ad8247e0a8ce5625, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.286503 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.300405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1310/2578] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:52 2022] PUT /identity/v3/projects/d25b314c43254d1dbb5c299e06ef0ed8/users/ce8d0e3d8e5b44d3ad8247e0a8ce5625/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:52.304391 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.314676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc05b33-9229-45eb-be06-dc22d58e1cd0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.350856 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.352581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.376735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.377261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.377539 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.377811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.379013 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.380583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.390147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1269/2579] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:52.394774 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.405069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6a4a6-5ec3-4ea4-9af6-bce76b6c7468 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.410414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ee43-2c72-4af7-b4fb-32a561011a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.411119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ee43-2c72-4af7-b4fb-32a561011a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.411397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ee43-2c72-4af7-b4fb-32a561011a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.411671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ee43-2c72-4af7-b4fb-32a561011a20 admin admin] PATH_INFO: `/v3/projects/d25b314c43254d1dbb5c299e06ef0ed8/users/ce8d0e3d8e5b44d3ad8247e0a8ce5625/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.413589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178ee43-2c72-4af7-b4fb-32a561011a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25b314c43254d1dbb5c299e06ef0ed8, user_id=ce8d0e3d8e5b44d3ad8247e0a8ce5625, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.416307 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178ee43-2c72-4af7-b4fb-32a561011a20 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.419562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:52.423104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bc0b0-ea24-4bae-acd1-1b5831a42269 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.429460 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1270/2580] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:52 2022] PUT /identity/v3/projects/d25b314c43254d1dbb5c299e06ef0ed8/users/ce8d0e3d8e5b44d3ad8247e0a8ce5625/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:52.441486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.441804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.442081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.475572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] MFA Rules not processed for user `ce8d0e3d8e5b44d3ad8247e0a8ce5625`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:52.476797 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.489213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.489847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.490129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.490403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] PATH_INFO: `/v3/users/1537d48c9e7146f58c97b16950853b5d` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.491551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1537d48c9e7146f58c97b16950853b5d)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.493506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.542456 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1537d48c9e7146f58c97b16950853b5d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:52.548832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1271/2581] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:52.549872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1537d48c9e7146f58c97b16950853b5d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:52.555704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:52.557837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1537d48c9e7146f58c97b16950853b5d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:52.559693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.561164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.577917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1537d48c9e7146f58c97b16950853b5d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:52.578751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-c27d4a2f-e998-40c1-a25b-9222f7528e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1537d48c9e7146f58c97b16950853b5d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:52.585295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1311/2582] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:52 2022] DELETE /identity/v3/users/1537d48c9e7146f58c97b16950853b5d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:52.589670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.589954 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.590226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.608197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:52.609379 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.621825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6a117-98f8-45af-ba18-3d240ed3a766 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.673540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1312/2583] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:52.675844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.676451 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.676731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.677011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.678899 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.684006 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.685393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.730554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:52.743068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.744751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.747745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41638e90-1908-476e-adc7-5b866a0501ee None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.754122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.755532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.755716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.756065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.757972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1272/2584] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:52.767302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.768780 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.779941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1313/2585] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:52.845982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:52.848259 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.861766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc723825-2b3b-4aae-967d-793f6774ceb4 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:52.867922 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:52.868529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.868815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.869144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.880493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.888282 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:52.889991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:52.900930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1273/2586] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:53.136317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:53.138270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:53.160767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbde7-81cb-4459-8a06-a8f471b940d2 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:53.186796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:53.186796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:53.186796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:53.186796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] PATH_INFO: `/v3/projects/245512d612b24c478272a2b7a373ef78` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:53.187222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=245512d612b24c478272a2b7a373ef78)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:53.187222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:53.251909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245512d612b24c478272a2b7a373ef78', 'request_id': 'req-687dbc32-941a-4725-8003-1ed2d604d456'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.258932 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245512d612b24c478272a2b7a373ef78', 'request_id': 'req-687dbc32-941a-4725-8003-1ed2d604d456'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.268868 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245512d612b24c478272a2b7a373ef78', 'request_id': 'req-687dbc32-941a-4725-8003-1ed2d604d456'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.283077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] The token cache is being invalidate because project 245512d612b24c478272a2b7a373ef78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:53.283404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.284686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.286649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1314/2587] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:53 2022] DELETE /identity/v3/projects/245512d612b24c478272a2b7a373ef78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:53.290799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:53.302085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e41df-03ab-450f-ae78-8972b74ad529 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:53.367541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:53.368189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:53.368473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:53.368765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] PATH_INFO: `/v3/users/6fc35bf198944e289c6c2bddaf11c97e` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:53.370067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc35bf198944e289c6c2bddaf11c97e)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:53.372043 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:53.425431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc35bf198944e289c6c2bddaf11c97e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.434250 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc35bf198944e289c6c2bddaf11c97e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.447274 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc35bf198944e289c6c2bddaf11c97e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.454214 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc35bf198944e289c6c2bddaf11c97e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.455016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a2e40594-a82a-44c1-aea2-ec70a2eb6846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc35bf198944e289c6c2bddaf11c97e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.461669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1274/2588] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:53 2022] DELETE /identity/v3/users/6fc35bf198944e289c6c2bddaf11c97e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:53.782795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:53.784353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:53.794357 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:53.800111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbc32-941a-4725-8003-1ed2d604d456 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:53.881701 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:53.882353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:53.882770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:53.882978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] PATH_INFO: `/v3/projects/348c04c7cc304b19b49d4dbc9bb7bf4e` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:53.884050 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348c04c7cc304b19b49d4dbc9bb7bf4e)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:53.886044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:53.941446 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348c04c7cc304b19b49d4dbc9bb7bf4e', 'request_id': 'req-941819b7-9eb9-497e-a0d3-36b8c9442bd6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.948101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348c04c7cc304b19b49d4dbc9bb7bf4e', 'request_id': 'req-941819b7-9eb9-497e-a0d3-36b8c9442bd6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.955684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348c04c7cc304b19b49d4dbc9bb7bf4e', 'request_id': 'req-941819b7-9eb9-497e-a0d3-36b8c9442bd6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.966995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] The token cache is being invalidate because project 348c04c7cc304b19b49d4dbc9bb7bf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:53.967282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.967945 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-941819b7-9eb9-497e-a0d3-36b8c9442bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:53.969454 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1315/2589] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:53 2022] DELETE /identity/v3/projects/348c04c7cc304b19b49d4dbc9bb7bf4e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:53.976020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:53.976237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:53.976507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:53.997319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:53.998645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:54.065294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:54.087615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1275/2590] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:54.095222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.095514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.095797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.116439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:54.117683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:54.129435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1316/2591] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:54.133682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.143929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79540bc9-44c1-495b-904a-404fe412e4e1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.148956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.149561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.149845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.150120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.150796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:54.151106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.153067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.165123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1276/2592] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:54.169499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.179789 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ec8a-c0ae-4365-bb3a-524a1bd2c6e7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.194259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.194259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.194259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.194259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.194903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.194903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.275201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1317/2593] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:54 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:54.278994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.292595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa22cd-69c3-4b0b-8beb-dc72952441a7 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.375126 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.375901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.376207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.376729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.377510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.380141 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.405623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1277/2594] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:54 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:54.410488 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.428876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9d379-8b99-4c8f-8f37-1dc95242a0f0 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.436099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.436737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.437016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.437268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.438510 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.440387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.459089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1318/2595] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:54.463731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.477656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b46f24-f078-4159-be7b-bcabd4f391b4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.482597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc2056-535a-4d36-af20-3ac47b49e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.483374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc2056-535a-4d36-af20-3ac47b49e8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.483767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc2056-535a-4d36-af20-3ac47b49e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.484142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc2056-535a-4d36-af20-3ac47b49e8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.484909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc2056-535a-4d36-af20-3ac47b49e8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.486601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc2056-535a-4d36-af20-3ac47b49e8b9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.500491 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1278/2596] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:54.504899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.514796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99f9b1-9ba2-4ce4-9f96-f09a4f8c66a2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.519369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.520009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.520286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.520592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] PATH_INFO: `/v3/projects/86f340c6cd0a43dcbf14509130a6f0c0/users/ca50c37583b14bf4b6f4027639b1b073/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.535502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f340c6cd0a43dcbf14509130a6f0c0, user_id=ca50c37583b14bf4b6f4027639b1b073, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.538151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.551527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1319/2597] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:54 2022] PUT /identity/v3/projects/86f340c6cd0a43dcbf14509130a6f0c0/users/ca50c37583b14bf4b6f4027639b1b073/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:54.561650 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.562860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.562860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.589664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] MFA Rules not processed for user `ca50c37583b14bf4b6f4027639b1b073`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:54.590906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:54.662483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1279/2598] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:54.667143 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.702237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:54.734817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d71921-3cf2-4a62-b1de-414e6cd74648 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.740593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.741203 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.741542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.741817 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.742459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.744401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.785530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1320/2599] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:54 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:54.790257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.803260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569f46e-79f3-43b2-af5a-4f8a49bce893 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.864386 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:54.882632 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.883483 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.883956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.884420 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.885207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.887629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.926219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1280/2600] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:54 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:54.930385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.943455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e69a-dfe7-489d-91ac-34d068811566 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.948885 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.949662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.950049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.950431 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:54.951246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:54.952981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:54.973439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1321/2601] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:54.974654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:54.985238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd725-3ad0-4b69-a18e-8f2242243768 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:54.990980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:54.991661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:54.992569 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:54.992843 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] PATH_INFO: `/v3/projects/f6cb24483be0456b89261d1745a5f87b/users/cf2e9fb85556448a81f57b7a6d284d96/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.012002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cb24483be0456b89261d1745a5f87b, user_id=cf2e9fb85556448a81f57b7a6d284d96, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.014686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.039218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1281/2602] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:54 2022] PUT /identity/v3/projects/f6cb24483be0456b89261d1745a5f87b/users/cf2e9fb85556448a81f57b7a6d284d96/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:55.043941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.053938 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946d187-57a6-425f-a0c4-d43474744560 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.132194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0994-9c5b-4db3-8c30-93337517445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.133174 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0994-9c5b-4db3-8c30-93337517445c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.133655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0994-9c5b-4db3-8c30-93337517445c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.134128 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0994-9c5b-4db3-8c30-93337517445c admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.135021 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0994-9c5b-4db3-8c30-93337517445c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.136816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0994-9c5b-4db3-8c30-93337517445c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.155571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1322/2603] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:55.160828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.171436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986504f-7c72-4aae-a74f-b861d85cedaa admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.177110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.177905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.178207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.178546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] PATH_INFO: `/v3/projects/f6cb24483be0456b89261d1745a5f87b/users/cf2e9fb85556448a81f57b7a6d284d96/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.180754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cb24483be0456b89261d1745a5f87b, user_id=cf2e9fb85556448a81f57b7a6d284d96, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.183523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.196427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1282/2604] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:55 2022] PUT /identity/v3/projects/f6cb24483be0456b89261d1745a5f87b/users/cf2e9fb85556448a81f57b7a6d284d96/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:55.208225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.208637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.209015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.239265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] MFA Rules not processed for user `cf2e9fb85556448a81f57b7a6d284d96`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:55.240562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.326906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1323/2605] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:55.345373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.348279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.418461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26cbc5-f73e-46fb-87d2-ec111a3a4d34 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.422191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.422941 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.423292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.423637 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.433826 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.435589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.448777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1283/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:55.479273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.505580 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.507051 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.524166 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:55.560901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37bb38-cba8-476c-bc20-8ab39420e837 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.566376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.567112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.567395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.567660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] PATH_INFO: `/v3/users/ca50c37583b14bf4b6f4027639b1b073` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.568826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca50c37583b14bf4b6f4027639b1b073)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.570914 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.585449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add93508-9769-46b4-9bc7-3384ac4382b0 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.590374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.591122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.591466 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.591808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] PATH_INFO: `/v3/users/ef4892f15fbf4524a50708080fa38218` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.593019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4892f15fbf4524a50708080fa38218)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.595027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.621606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca50c37583b14bf4b6f4027639b1b073'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.633797 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca50c37583b14bf4b6f4027639b1b073'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.643574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca50c37583b14bf4b6f4027639b1b073'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.657766 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4892f15fbf4524a50708080fa38218'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.659353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca50c37583b14bf4b6f4027639b1b073'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.660327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f5ec65dd-63ba-4926-8ecf-cdf6b1a13a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca50c37583b14bf4b6f4027639b1b073'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.661261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:55.667435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1324/2607] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:55 2022] DELETE /identity/v3/users/ca50c37583b14bf4b6f4027639b1b073 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:55.667701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4892f15fbf4524a50708080fa38218'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.673076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.673545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.674329 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.687775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4892f15fbf4524a50708080fa38218'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.695489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:55.696702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.699605 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4892f15fbf4524a50708080fa38218'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.700450 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-af38436d-b793-465c-b087-a0e78986fd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4892f15fbf4524a50708080fa38218'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:55.707636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1284/2608] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:55 2022] DELETE /identity/v3/users/ef4892f15fbf4524a50708080fa38218 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:55.712092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.712882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.713376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.741693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:55.743467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.765900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1325/2609] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:55.779733 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.782293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.821370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1285/2610] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:55.828474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.830407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.843935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:55.849702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109f0af-a029-41dd-aead-38d6b4308e65 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.908038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cabf1-cd32-42a9-9531-9c12fb5d80d8 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.913280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.914159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.915004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.915004 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.920348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.923307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.923662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.924615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.934546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.935734 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:55.938215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.938347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:55.949033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1326/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:55.949213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1286/2612] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:56.593616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:56.597339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:56.622777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:56.624103 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685760-e34c-45a3-b477-36064d52a711 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:56.625275 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:56.635466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:56.636165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:56.636533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:56.636785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] PATH_INFO: `/v3/projects/87bbce9e77494b81badc539d9117beed` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:56.638852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87bbce9e77494b81badc539d9117beed)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:56.641971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:56.664715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768fbd3-8954-4e62-bdb6-579a8ae0480a service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:56.679768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:56.680532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:56.680867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:56.681223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] PATH_INFO: `/v3/projects/86f340c6cd0a43dcbf14509130a6f0c0` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:56.683918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f340c6cd0a43dcbf14509130a6f0c0)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:56.686092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:56.722439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87bbce9e77494b81badc539d9117beed', 'request_id': 'req-e8ebf744-3b1c-4fe8-bcca-921898647bd6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.735122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87bbce9e77494b81badc539d9117beed', 'request_id': 'req-e8ebf744-3b1c-4fe8-bcca-921898647bd6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.747664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87bbce9e77494b81badc539d9117beed', 'request_id': 'req-e8ebf744-3b1c-4fe8-bcca-921898647bd6'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.760906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] The token cache is being invalidate because project 87bbce9e77494b81badc539d9117beed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:56.761455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.761972 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.765407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f340c6cd0a43dcbf14509130a6f0c0', 'request_id': 'req-d99006dd-3f6b-432e-87b8-05eb51720812'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.765532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1327/2613] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:56 2022] DELETE /identity/v3/projects/87bbce9e77494b81badc539d9117beed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:56.773602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:56.775164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f340c6cd0a43dcbf14509130a6f0c0', 'request_id': 'req-d99006dd-3f6b-432e-87b8-05eb51720812'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.777019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:56.785221 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f340c6cd0a43dcbf14509130a6f0c0', 'request_id': 'req-d99006dd-3f6b-432e-87b8-05eb51720812'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.790661 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:56.802862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] The token cache is being invalidate because project 86f340c6cd0a43dcbf14509130a6f0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:56.803596 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.805040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.807548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1287/2614] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:56 2022] DELETE /identity/v3/projects/86f340c6cd0a43dcbf14509130a6f0c0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:56.811314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:56.813522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:56.867062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebf744-3b1c-4fe8-bcca-921898647bd6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:56.895845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99006dd-3f6b-432e-87b8-05eb51720812 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:56.900602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:56.901235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:56.901516 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:56.901791 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] PATH_INFO: `/v3/users/cf2e9fb85556448a81f57b7a6d284d96` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:56.903130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2e9fb85556448a81f57b7a6d284d96)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:56.905046 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:56.905634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:56.934011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:56.934688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:56.934971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:56.935336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] PATH_INFO: `/v3/users/ce8d0e3d8e5b44d3ad8247e0a8ce5625` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:56.936666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8d0e3d8e5b44d3ad8247e0a8ce5625)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:56.939218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:56.954198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2e9fb85556448a81f57b7a6d284d96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.963346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2e9fb85556448a81f57b7a6d284d96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.976666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2e9fb85556448a81f57b7a6d284d96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.983646 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2e9fb85556448a81f57b7a6d284d96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.984319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2e9fb85556448a81f57b7a6d284d96'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.988001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8d0e3d8e5b44d3ad8247e0a8ce5625'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:56.993520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1288/2615] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:56 2022] DELETE /identity/v3/users/cf2e9fb85556448a81f57b7a6d284d96 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:56.993520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:56.993520 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:56.998428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8d0e3d8e5b44d3ad8247e0a8ce5625'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.008698 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8d0e3d8e5b44d3ad8247e0a8ce5625'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.022955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8d0e3d8e5b44d3ad8247e0a8ce5625'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.023766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8d0e3d8e5b44d3ad8247e0a8ce5625'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.030848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1328/2616] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:56 2022] DELETE /identity/v3/users/ce8d0e3d8e5b44d3ad8247e0a8ce5625 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:57.078928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa7d3-d637-4da6-a844-f95165692d8d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:57.100756 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:57.155983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:57.156636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.156921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.157203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] PATH_INFO: `/v3/users/7d02a90e6cb7428985fe399974b385b9` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.158935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d02a90e6cb7428985fe399974b385b9)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:57.160745 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:57.235264 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d02a90e6cb7428985fe399974b385b9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.244992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d02a90e6cb7428985fe399974b385b9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.259602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d02a90e6cb7428985fe399974b385b9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.267159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d02a90e6cb7428985fe399974b385b9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.267887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d02a90e6cb7428985fe399974b385b9'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.274289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1289/2617] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:56:56 2022] DELETE /identity/v3/users/7d02a90e6cb7428985fe399974b385b9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:57.388700 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:57.390225 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.417194 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:57.419014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.443922 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517197-e902-4559-9942-4003792b1cd6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:57.522943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:57.523668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.524062 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.524495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] PATH_INFO: `/v3/projects/f6cb24483be0456b89261d1745a5f87b` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.525816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cb24483be0456b89261d1745a5f87b)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:57.527927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:57.535928 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf108-f47b-43d1-8a37-5e7aa4b1e17e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:57.542583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:57.543751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.543945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.544546 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] PATH_INFO: `/v3/projects/d25b314c43254d1dbb5c299e06ef0ed8` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.545722 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25b314c43254d1dbb5c299e06ef0ed8)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:57.547668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:57.587406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cb24483be0456b89261d1745a5f87b', 'request_id': 'req-9580092d-8f15-4db8-8fd5-2d0a6baa6048'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.594751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cb24483be0456b89261d1745a5f87b', 'request_id': 'req-9580092d-8f15-4db8-8fd5-2d0a6baa6048'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.598314 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:57.599377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:57.606200 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cb24483be0456b89261d1745a5f87b', 'request_id': 'req-9580092d-8f15-4db8-8fd5-2d0a6baa6048'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.608651 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25b314c43254d1dbb5c299e06ef0ed8', 'request_id': 'req-1f66933a-163f-413c-a800-ff40dfd0bf3c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.617023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25b314c43254d1dbb5c299e06ef0ed8', 'request_id': 'req-1f66933a-163f-413c-a800-ff40dfd0bf3c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.622963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] The token cache is being invalidate because project f6cb24483be0456b89261d1745a5f87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:57.623325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.623941 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.625533 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1329/2618] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:57 2022] DELETE /identity/v3/projects/f6cb24483be0456b89261d1745a5f87b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:57.627116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25b314c43254d1dbb5c299e06ef0ed8', 'request_id': 'req-1f66933a-163f-413c-a800-ff40dfd0bf3c'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.630628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:57.632073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.650467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] The token cache is being invalidate because project d25b314c43254d1dbb5c299e06ef0ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:57.650841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.652898 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-1f66933a-163f-413c-a800-ff40dfd0bf3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.655087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1290/2619] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:57 2022] DELETE /identity/v3/projects/d25b314c43254d1dbb5c299e06ef0ed8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:57.659072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8f126-48be-46cb-ad70-b31145291c95 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.659072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8f126-48be-46cb-ad70-b31145291c95 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.659072 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8f126-48be-46cb-ad70-b31145291c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.680383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-99d8f126-48be-46cb-ad70-b31145291c95 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:57.681613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-99d8f126-48be-46cb-ad70-b31145291c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.711870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580092d-8f15-4db8-8fd5-2d0a6baa6048 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:57.745058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1291/2620] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:57.746685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84608e42-4cc5-4c5e-a23d-5b37834f4410 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.747086 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84608e42-4cc5-4c5e-a23d-5b37834f4410 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.747380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84608e42-4cc5-4c5e-a23d-5b37834f4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.767009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-84608e42-4cc5-4c5e-a23d-5b37834f4410 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:57.768228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-84608e42-4cc5-4c5e-a23d-5b37834f4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.773828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:57.774437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.774816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.775029 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] PATH_INFO: `/v3/projects/34010de730e4448288baf7e944d52cf9` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.776148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34010de730e4448288baf7e944d52cf9)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:57.783019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1292/2621] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:57.783019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc694-6263-457b-93cd-5913f29d4805 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.783280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:57.783377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc694-6263-457b-93cd-5913f29d4805 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.783377 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc694-6263-457b-93cd-5913f29d4805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.800168 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8bdcc694-6263-457b-93cd-5913f29d4805 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:57.801366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8bdcc694-6263-457b-93cd-5913f29d4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.809849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1293/2622] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:57.811052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c64cd8-9e06-4092-9b58-d5dc9dd688b8 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.811331 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c64cd8-9e06-4092-9b58-d5dc9dd688b8 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.811599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c64cd8-9e06-4092-9b58-d5dc9dd688b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.824818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34010de730e4448288baf7e944d52cf9', 'request_id': 'req-042408ab-1c83-42b8-9da4-f6b75f8a5786'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.830932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-03c64cd8-9e06-4092-9b58-d5dc9dd688b8 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:57.831794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34010de730e4448288baf7e944d52cf9', 'request_id': 'req-042408ab-1c83-42b8-9da4-f6b75f8a5786'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.832679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-03c64cd8-9e06-4092-9b58-d5dc9dd688b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.838917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34010de730e4448288baf7e944d52cf9', 'request_id': 'req-042408ab-1c83-42b8-9da4-f6b75f8a5786'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.850353 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] The token cache is being invalidate because project 34010de730e4448288baf7e944d52cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:56:57.850677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.851337 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:56:57.852842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1330/2623] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:56:57 2022] DELETE /identity/v3/projects/34010de730e4448288baf7e944d52cf9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:57.853683 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:57.855071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.890429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:57.921185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1294/2624] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:57.922714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.923020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.923299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.944417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:57.944670 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042408ab-1c83-42b8-9da4-f6b75f8a5786 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:57.945628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.949227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:57.949837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.950115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.950387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.951066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:57.951375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:57.952958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303f26f-e70d-4633-9281-1a91c0330de3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:57.954034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1295/2625] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:57.954915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:57.965426 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d353-3b66-4604-a6d5-6eccda803759 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:57.966769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1331/2626] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:57.967918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.968201 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.968469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.974932 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:57.975575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:57.975915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:57.976203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:57.976854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:57.977159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:57.979034 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:57.989831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:57.991184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:57.992303 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1296/2627] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:57.992831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.002716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b192db-3432-4f37-957c-a7bb783c338c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.005435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1332/2628] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:58.006080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.011431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.012728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.013012 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.013294 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.014131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.016070 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.016256 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eac800-1608-4209-b1ce-cacb9858f304 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.021056 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.021659 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.021939 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.022245 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.022903 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.024805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.045324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1297/2629] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:57 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.046312 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.062150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1333/2630] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.062150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.070219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:58.120550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0793ad-31f6-4bd6-9cea-57c9712b9510 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.125272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.125882 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.126165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.126440 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.127124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:56:58.127428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.128839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7bd4a-e40a-45a0-8d5d-07d46a071d9e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.129636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.133544 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.134148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.134432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.134747 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.135471 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.138183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.142090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1298/2631] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:56:58.142908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.152501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84beffb-6e1c-462c-a6d9-fe838c409297 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.157355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.157936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.158255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.158486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.159155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.161052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.166542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1334/2632] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.167223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.178218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80545ce-e42b-432f-8c2a-8d1816f29739 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.184288 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1299/2633] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.186266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.186266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.186506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.186677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.187639 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.188286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.189588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.199181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478950c-b9dc-4874-bf91-a8baeeb61d7a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.203894 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.204875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.205374 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.205888 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.206792 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.209936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.217989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1335/2634] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.219153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.227463 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1300/2635] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:58.228654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.244147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081094a-c7a9-4029-b729-a4dc47f17fb2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.314265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:58.323396 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369d14a-ea7d-4a13-8bb1-ef2ff9e46e43 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.328813 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.329424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.329709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.329975 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.330646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.332294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.341206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.342442 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.342692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1336/2636] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:58.343468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.343591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.344094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.345268 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.349675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.354489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afca91-55f6-4b47-be04-e317a84abc9e admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.360089 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.361233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.361833 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.362288 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.363461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.365326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.373165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1301/2637] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.375735 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.375877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1337/2638] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:58.377358 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.387898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a55a3-752b-4c0f-9781-5e46789e439f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.388078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b85c9-7634-4d74-b80a-f2124747926a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.392418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.392993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.393123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.393272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.393596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.393703 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.393931 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.394213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.394315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.394939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.395816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.396584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.406480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1338/2639] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:58.410489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1302/2640] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:58.410660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.411398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.417246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc937-d484-4fa0-8df4-97b1015ca9a7 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.421443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eab3b-f77b-43d6-b7b2-f0952c5f0171 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.421956 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.422598 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.422907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.423179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] PATH_INFO: `/v3/projects/231c5ac7ba0441d6bb3c5e2068a9c074/users/96094fa5a47d4d6fb6366b56deb47ed5/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.426807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.427528 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.427807 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.428198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.428833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.430660 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.438475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231c5ac7ba0441d6bb3c5e2068a9c074, user_id=96094fa5a47d4d6fb6366b56deb47ed5, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.441277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.441668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1303/2641] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:58.443684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.454782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1339/2642] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:58 2022] PUT /identity/v3/projects/231c5ac7ba0441d6bb3c5e2068a9c074/users/96094fa5a47d4d6fb6366b56deb47ed5/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:58.455280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2ebde-ad6a-47cf-a05c-d7cdfef27171 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.455558 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.509107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:58.518408 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bcbeb-0bb5-4c4b-9246-b731290c8c42 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.523669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd581c-3326-49e8-98b6-725e8ce0680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.524224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c3a6-279d-4ebf-afeb-2d0a812861a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.524352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd581c-3326-49e8-98b6-725e8ce0680d admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.524586 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd581c-3326-49e8-98b6-725e8ce0680d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.524859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd581c-3326-49e8-98b6-725e8ce0680d admin admin] PATH_INFO: `/v3/projects/d1f1b22daf404398a82fc8069942de65/users/371e8955d5604d299284cd95d17be85b/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.524972 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c3a6-279d-4ebf-afeb-2d0a812861a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.525169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c3a6-279d-4ebf-afeb-2d0a812861a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.525439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c3a6-279d-4ebf-afeb-2d0a812861a2 admin admin] PATH_INFO: `/v3/projects/e5c85fe65feb4b3f890372c8da841629/users/bdbf4f974f1747188e46c85a3601124a/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.540709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086c3a6-279d-4ebf-afeb-2d0a812861a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c85fe65feb4b3f890372c8da841629, user_id=bdbf4f974f1747188e46c85a3601124a, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.541188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd581c-3326-49e8-98b6-725e8ce0680d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f1b22daf404398a82fc8069942de65, user_id=371e8955d5604d299284cd95d17be85b, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.544080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086c3a6-279d-4ebf-afeb-2d0a812861a2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.544383 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd581c-3326-49e8-98b6-725e8ce0680d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.558218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1340/2643] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:58 2022] PUT /identity/v3/projects/d1f1b22daf404398a82fc8069942de65/users/371e8955d5604d299284cd95d17be85b/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:58.559762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.560055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.560330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.563943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1304/2644] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:58 2022] PUT /identity/v3/projects/e5c85fe65feb4b3f890372c8da841629/users/bdbf4f974f1747188e46c85a3601124a/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:58.569556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c28f7-32d6-495d-a47c-c5766491e9ec None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.569844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c28f7-32d6-495d-a47c-c5766491e9ec None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.570123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c28f7-32d6-495d-a47c-c5766491e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.590050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-1f7c28f7-32d6-495d-a47c-c5766491e9ec None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:58.591424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-1f7c28f7-32d6-495d-a47c-c5766491e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:58.595437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] MFA Rules not processed for user `96094fa5a47d4d6fb6366b56deb47ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:58.596632 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:58.655216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1305/2645] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:58.656521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.656805 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.657077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.666108 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1341/2646] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:58.667618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.669427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:58.687248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] MFA Rules not processed for user `371e8955d5604d299284cd95d17be85b`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:58.688712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:58.689832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:58.728591 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a506e-6236-4ffe-8cc7-d69e5fd8d439 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.732241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.732837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.733122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.733397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.742908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.744345 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.753480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1306/2647] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:58.754375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1342/2648] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:58.754906 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.757866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.765801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ff96-9677-42b4-986e-cbf35d013bd3 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.767191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbd518-4dcb-4224-8e9d-d4a5aea2efc8 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.771059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.772069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.772069 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.772274 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.772381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.772686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.772808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.773025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.773307 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.774084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.774834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.776027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.805207 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1307/2649] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.810351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1343/2650] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:58.810506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.811328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.860238 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:58.875581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628dba3-55bd-4353-b18e-57c9a2b9bd15 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.881169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.881777 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.882070 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.882336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.883087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.885001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.897729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a92b-2aed-415f-8481-d404ba3260b9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.903424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.904156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.904535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.905262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.906077 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.907124 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1344/2651] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:56:58.910587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.911164 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.921957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a296e-5908-4846-986b-d0ef5cac7347 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.928523 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.929237 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.929524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.929837 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.930427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.932083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.938337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1308/2652] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:56:58 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:56:58.942710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.947981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1345/2653] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:58.953335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.958983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b465f-929e-4eda-afc2-583f4dd8b6e2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.963684 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.964286 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.964564 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.964836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.965502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:58.967260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:58.976477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f023ef-be60-4b52-8f86-477c451198d2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:58.982098 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1309/2654] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:56:58.986191 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:58.987919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:58.988549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:58.988826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:58.989097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] PATH_INFO: `/v3/projects/f830e3a56c444ad8991730093f54c0e4/users/fd7eafa3b9dc434185cd8c9ef7c8d571/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:58.997102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c37c4-f743-4d5c-bd7c-abfa1f58e9a8 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.002310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.003731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.003869 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.004078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] PATH_INFO: `/v3/projects/4a66b77d07de4b3c9d1ae02c1ae8dd8a/users/c96e7912214241f6a50f29ba939b622e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.007667 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f830e3a56c444ad8991730093f54c0e4, user_id=fd7eafa3b9dc434185cd8c9ef7c8d571, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.010440 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.019739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a66b77d07de4b3c9d1ae02c1ae8dd8a, user_id=c96e7912214241f6a50f29ba939b622e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.022501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.026085 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1346/2655] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:58 2022] PUT /identity/v3/projects/f830e3a56c444ad8991730093f54c0e4/users/fd7eafa3b9dc434185cd8c9ef7c8d571/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:59.029851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.039521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1310/2656] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:58 2022] PUT /identity/v3/projects/4a66b77d07de4b3c9d1ae02c1ae8dd8a/users/c96e7912214241f6a50f29ba939b622e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:59.043701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.095876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:59.110687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb459a8-c218-46e7-9f8a-cafcbe657dc6 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.130710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608287c-6af3-478c-b689-a916ec6b8246 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.137273 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.137896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.138174 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.138494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.139182 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.141863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.163642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1311/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:59.167600 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.180317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1990b-748e-4711-b667-89f6158a0766 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.186241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18777108-8a59-47a2-b28a-c99a9d95ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.187752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18777108-8a59-47a2-b28a-c99a9d95ed6e admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.188039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18777108-8a59-47a2-b28a-c99a9d95ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.188319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18777108-8a59-47a2-b28a-c99a9d95ed6e admin admin] PATH_INFO: `/v3/projects/4a66b77d07de4b3c9d1ae02c1ae8dd8a/users/c96e7912214241f6a50f29ba939b622e/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.191204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18777108-8a59-47a2-b28a-c99a9d95ed6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a66b77d07de4b3c9d1ae02c1ae8dd8a, user_id=c96e7912214241f6a50f29ba939b622e, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.195143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18777108-8a59-47a2-b28a-c99a9d95ed6e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.195946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.196748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.197076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.197341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.198025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.199647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.210142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1347/2658] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:56:59.214104 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.215905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1312/2659] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:59 2022] PUT /identity/v3/projects/4a66b77d07de4b3c9d1ae02c1ae8dd8a/users/c96e7912214241f6a50f29ba939b622e/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:56:59.227430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.227620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.227981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.232704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80932f0-33a9-4204-8b6b-60498202bec2 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.257235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] MFA Rules not processed for user `c96e7912214241f6a50f29ba939b622e`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:59.258505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:59.295989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f26200-5ea4-4fbf-8402-8e1829b82496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.296717 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f26200-5ea4-4fbf-8402-8e1829b82496 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.297000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f26200-5ea4-4fbf-8402-8e1829b82496 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.297277 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f26200-5ea4-4fbf-8402-8e1829b82496 admin admin] PATH_INFO: `/v3/projects/f830e3a56c444ad8991730093f54c0e4/users/fd7eafa3b9dc434185cd8c9ef7c8d571/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.299331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f26200-5ea4-4fbf-8402-8e1829b82496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f830e3a56c444ad8991730093f54c0e4, user_id=fd7eafa3b9dc434185cd8c9ef7c8d571, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.302680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f26200-5ea4-4fbf-8402-8e1829b82496 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.318649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1348/2660] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:56:59 2022] PUT /identity/v3/projects/f830e3a56c444ad8991730093f54c0e4/users/fd7eafa3b9dc434185cd8c9ef7c8d571/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:56:59.325707 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.326326 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.326896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.344157 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1313/2661] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:59.355737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.359470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:59.365027 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] MFA Rules not processed for user `fd7eafa3b9dc434185cd8c9ef7c8d571`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:59.366230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:59.366502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:59.435178 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59464a24-7e65-4717-9e51-1fafe1584ee6 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.474644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1349/2662] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:59.483961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.486595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:59.496052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.496759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.497115 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.497461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.507481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:59.552626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde9c1-3bad-49b6-92c5-3b0e4e2f5f8a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.556781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79344dd2-9bfb-45fb-be8c-e393a0a69caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.557482 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344dd2-9bfb-45fb-be8c-e393a0a69caf service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.557988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344dd2-9bfb-45fb-be8c-e393a0a69caf service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.558348 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344dd2-9bfb-45fb-be8c-e393a0a69caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.569073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79344dd2-9bfb-45fb-be8c-e393a0a69caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.570644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79344dd2-9bfb-45fb-be8c-e393a0a69caf service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.571753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.573260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.581900 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1350/2663] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:59.583155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.583522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.583861 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.584598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1314/2664] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:59.617930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] MFA Rules not processed for user `bdbf4f974f1747188e46c85a3601124a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:59.619767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:59.705561 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.715414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf1a95-ba51-4556-80b2-cd0d82122a00 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.719134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.719731 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.720009 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.720281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.727047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1351/2665] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:59.728170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:59.737295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25689-439b-4b5c-b119-f38bada6cca6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:59.740906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173366a5-016f-4dce-b72f-e3247b9e9e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:59.741490 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173366a5-016f-4dce-b72f-e3247b9e9e16 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:59.741767 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173366a5-016f-4dce-b72f-e3247b9e9e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:59.742039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173366a5-016f-4dce-b72f-e3247b9e9e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:59.782265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.783947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.793106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1315/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:59.799276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173366a5-016f-4dce-b72f-e3247b9e9e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:59.800742 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173366a5-016f-4dce-b72f-e3247b9e9e16 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:59.809609 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1352/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:00.054003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:00.069998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8ede0-aee3-4c20-8815-91fc80b70b9c service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:00.076390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:00.077106 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:00.077515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:00.077858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:00.084446 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:00.088551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:00.090802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:00.101694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1316/2668] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:01.470142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e040bfe-e687-4487-a29e-ebb81cc78795 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:01.470718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e040bfe-e687-4487-a29e-ebb81cc78795 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:01.470930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e040bfe-e687-4487-a29e-ebb81cc78795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:01.489804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8e040bfe-e687-4487-a29e-ebb81cc78795 None None] MFA Rules not processed for user `bdbf4f974f1747188e46c85a3601124a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:01.491054 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8e040bfe-e687-4487-a29e-ebb81cc78795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:01.498024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1353/2669] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:02.474838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:02.552884 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82478e28-0a6b-421f-a392-c30a2a323ffd service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:02.558082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:02.558955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:02.565346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:02.565346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] PATH_INFO: `/v3/users/96094fa5a47d4d6fb6366b56deb47ed5` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:02.566734 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96094fa5a47d4d6fb6366b56deb47ed5)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:02.568819 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:02.624850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96094fa5a47d4d6fb6366b56deb47ed5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:02.634130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96094fa5a47d4d6fb6366b56deb47ed5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:02.649968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96094fa5a47d4d6fb6366b56deb47ed5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:02.664064 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96094fa5a47d4d6fb6366b56deb47ed5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:02.664776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96094fa5a47d4d6fb6366b56deb47ed5'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:02.671709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1317/2670] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:02 2022] DELETE /identity/v3/users/96094fa5a47d4d6fb6366b56deb47ed5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:02.676184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:02.676709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:02.676888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:02.697000 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:02.698209 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:02.734196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:02.763596 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1354/2671] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:02.771325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:02.772768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:02.835891 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc90860-51e3-4871-ba75-b36f93973e98 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:02.840066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:02.840726 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:02.841140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:02.841568 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:02.856363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:02.857912 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:02.882760 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1318/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:03.184862 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:03.187129 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:03.203718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81ef8-f421-4b26-8199-96f0a75de2b7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:03.209413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:03.210871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:03.217841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:03.218713 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] PATH_INFO: `/v3/projects/231c5ac7ba0441d6bb3c5e2068a9c074` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:03.220723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=231c5ac7ba0441d6bb3c5e2068a9c074)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:03.222730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:03.318047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231c5ac7ba0441d6bb3c5e2068a9c074', 'request_id': 'req-9622139f-e5ce-489b-b6b5-95f644bd4c0d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.326185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231c5ac7ba0441d6bb3c5e2068a9c074', 'request_id': 'req-9622139f-e5ce-489b-b6b5-95f644bd4c0d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.336584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231c5ac7ba0441d6bb3c5e2068a9c074', 'request_id': 'req-9622139f-e5ce-489b-b6b5-95f644bd4c0d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.352890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] The token cache is being invalidate because project 231c5ac7ba0441d6bb3c5e2068a9c074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:03.353184 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.353849 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.355834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1355/2673] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:03 2022] DELETE /identity/v3/projects/231c5ac7ba0441d6bb3c5e2068a9c074 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:03.359939 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:03.372001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6865-92b1-4991-875b-44e676704e13 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:03.396453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:03.452050 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:03.452879 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:03.453227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:03.453610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] PATH_INFO: `/v3/users/c96e7912214241f6a50f29ba939b622e` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:03.454977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96e7912214241f6a50f29ba939b622e)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:03.457095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:03.516615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96e7912214241f6a50f29ba939b622e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.527975 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96e7912214241f6a50f29ba939b622e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.542839 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96e7912214241f6a50f29ba939b622e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.552647 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96e7912214241f6a50f29ba939b622e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.553599 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-61bf6179-9eee-4ae9-b209-423c9e1806a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96e7912214241f6a50f29ba939b622e'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:03.564480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1319/2674] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:03 2022] DELETE /identity/v3/users/c96e7912214241f6a50f29ba939b622e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:03.849014 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:03.853331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:03.881539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622139f-e5ce-489b-b6b5-95f644bd4c0d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:03.951374 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:03.952017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:03.952305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:03.952582 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] PATH_INFO: `/v3/projects/4a66b77d07de4b3c9d1ae02c1ae8dd8a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:03.954254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a66b77d07de4b3c9d1ae02c1ae8dd8a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:03.956812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.131105 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a66b77d07de4b3c9d1ae02c1ae8dd8a', 'request_id': 'req-0b60d7d1-cb25-4838-9e41-d52333df7ccd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.137606 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a66b77d07de4b3c9d1ae02c1ae8dd8a', 'request_id': 'req-0b60d7d1-cb25-4838-9e41-d52333df7ccd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.147476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a66b77d07de4b3c9d1ae02c1ae8dd8a', 'request_id': 'req-0b60d7d1-cb25-4838-9e41-d52333df7ccd'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.151593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:04.160898 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] The token cache is being invalidate because project 4a66b77d07de4b3c9d1ae02c1ae8dd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:04.161782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.162779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0b60d7d1-cb25-4838-9e41-d52333df7ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.164391 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1356/2675] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:03 2022] DELETE /identity/v3/projects/4a66b77d07de4b3c9d1ae02c1ae8dd8a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:04.169298 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.169583 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.169859 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.189356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:04.190754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:04.249453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1320/2676] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:04.257755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.258043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.258322 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.278547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:04.279770 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:04.288186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1357/2677] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:04.292526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.302667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9671-6398-4f11-9aa3-1a5c5f17ce44 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.308068 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.308777 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.309160 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.309610 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.310313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:57:04.310753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.312448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.326449 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1321/2678] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:57:04.330775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.341481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57204e-8bf5-44b6-bd2e-a132624b565d None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.345960 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.346549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.346908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.347233 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.347968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.349845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.380839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1358/2679] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:04 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:04.385249 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.396622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595010-8a08-4c2c-b918-e301a51beeed admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.415729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:04.459066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.459677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.459956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.460228 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.460853 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.462793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.484981 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1322/2680] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:04 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:04.489280 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.499467 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d34f9b-5672-4f74-ab77-0fa76a01f595 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.504646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.505250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.505527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.505798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.506573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.508204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.518414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1359/2681] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:04.522992 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.533324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8998a0-a0f0-439b-99b4-03122ed36361 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.538770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1029b-5f8e-4525-8015-15331e2a0af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.539091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1029b-5f8e-4525-8015-15331e2a0af0 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.539448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1029b-5f8e-4525-8015-15331e2a0af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.539803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1029b-5f8e-4525-8015-15331e2a0af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.540776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1029b-5f8e-4525-8015-15331e2a0af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.542454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1029b-5f8e-4525-8015-15331e2a0af0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.558773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1323/2682] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:57:04.560009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.570778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a11866-a933-472c-b485-1731b8815c12 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.576447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.577113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.577395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.577673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] PATH_INFO: `/v3/projects/38b82aee03a5478db300ef4475b372e8/users/b51c63c868854bee936154d27628b02d/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.599242 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b82aee03a5478db300ef4475b372e8, user_id=b51c63c868854bee936154d27628b02d, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.601961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.618055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1360/2683] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:04 2022] PUT /identity/v3/projects/38b82aee03a5478db300ef4475b372e8/users/b51c63c868854bee936154d27628b02d/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:04.623736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.624028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.624304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.648101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:04.649385 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:04.746834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1324/2684] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:04.757032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.759133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:04.772497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:04.774071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:04.786132 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c10c1-1ac0-4070-87cd-9931ce0d6000 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.791059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.791719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.791996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.792263 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] PATH_INFO: `/v3/users/371e8955d5604d299284cd95d17be85b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.793376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371e8955d5604d299284cd95d17be85b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.795311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.820716 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122adef-1171-4d6d-bc39-c07a1a4585ef admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:04.824800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0aa9-2dc2-495b-9bf6-015d0fa83785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:04.825403 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0aa9-2dc2-495b-9bf6-015d0fa83785 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.825877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0aa9-2dc2-495b-9bf6-015d0fa83785 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.826146 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0aa9-2dc2-495b-9bf6-015d0fa83785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.836477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0aa9-2dc2-495b-9bf6-015d0fa83785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:04.837901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0aa9-2dc2-495b-9bf6-015d0fa83785 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:04.847484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1361/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:04.850532 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371e8955d5604d299284cd95d17be85b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.867551 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371e8955d5604d299284cd95d17be85b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.889904 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371e8955d5604d299284cd95d17be85b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.898400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371e8955d5604d299284cd95d17be85b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.899345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371e8955d5604d299284cd95d17be85b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:04.905537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1325/2686] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:04 2022] DELETE /identity/v3/users/371e8955d5604d299284cd95d17be85b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:04.910205 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:04.911547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:04.911547 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:04.932537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:04.934292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:05.013918 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1362/2687] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:05.029775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:05.032237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:05.058349 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:05.119195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c750d-8328-41e6-a73f-313f10d3b2c2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:05.123410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:05.124206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:05.124545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:05.124945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:05.135213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:05.136768 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:05.148505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1326/2688] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:05.502202 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:05.503974 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:05.516138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f03d7-62e7-47f8-a7b1-36ed2185aada None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:05.521152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:05.521793 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:05.522527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:05.522527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] PATH_INFO: `/v3/projects/d1f1b22daf404398a82fc8069942de65` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:05.523540 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f1b22daf404398a82fc8069942de65)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:05.525458 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:05.557771 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:05.579823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f1b22daf404398a82fc8069942de65', 'request_id': 'req-9ab335bb-9999-4553-9506-9f6ca67a2a0f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.587462 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f1b22daf404398a82fc8069942de65', 'request_id': 'req-9ab335bb-9999-4553-9506-9f6ca67a2a0f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.595651 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f1b22daf404398a82fc8069942de65', 'request_id': 'req-9ab335bb-9999-4553-9506-9f6ca67a2a0f'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.609478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] The token cache is being invalidate because project d1f1b22daf404398a82fc8069942de65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:05.609766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.610417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9ab335bb-9999-4553-9506-9f6ca67a2a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.611924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1363/2689] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:05 2022] DELETE /identity/v3/projects/d1f1b22daf404398a82fc8069942de65 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:05.615887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:05.625367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89f120-6189-4e75-b727-2a813a7b10e4 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:05.685423 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:05.686056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:05.686332 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:05.686601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] PATH_INFO: `/v3/users/fd7eafa3b9dc434185cd8c9ef7c8d571` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:05.688000 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7eafa3b9dc434185cd8c9ef7c8d571)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:05.689905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:05.736527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7eafa3b9dc434185cd8c9ef7c8d571'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.743541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7eafa3b9dc434185cd8c9ef7c8d571'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.755966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7eafa3b9dc434185cd8c9ef7c8d571'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.762783 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7eafa3b9dc434185cd8c9ef7c8d571'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.763485 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7eafa3b9dc434185cd8c9ef7c8d571'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:05.770621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1327/2690] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:05 2022] DELETE /identity/v3/users/fd7eafa3b9dc434185cd8c9ef7c8d571 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:05.814466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:05.814466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:05.814466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:05.843290 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] MFA Rules not processed for user `b51c63c868854bee936154d27628b02d`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:05.844568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:05.923079 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1364/2691] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:05.927723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:05.929131 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:05.984372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:06.019929 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06932-c4e6-4000-a4b4-080934656a9e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.025024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.025620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.025902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.026206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.026871 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.028804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.057920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1328/2692] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:05 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:57:06.061995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.073618 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b000e-15ae-48f3-b54e-c8677bd6f8b6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.084376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.086315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:06.152336 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.152973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.153247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.153518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.154130 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.156204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.177967 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1365/2693] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:57:06.178306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c718-2d86-4ba2-92d1-0d66e0d1c895 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.181818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.183519 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.184196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.184479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.184751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] PATH_INFO: `/v3/projects/f830e3a56c444ad8991730093f54c0e4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.185907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f830e3a56c444ad8991730093f54c0e4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.188924 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.192099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e836f3-1253-4721-b696-46357736a6f4 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.196673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.197253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.197532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.197804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.198439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.200156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.210368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1366/2694] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:06.214262 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.223964 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4f471-1641-4343-bbb3-7c7c211005bd admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.228857 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.229661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.230007 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.230575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] PATH_INFO: `/v3/projects/3430a598e9564ab3b13eb669c65d52ef/users/7542a3de97844dc19c5cb96a55e21fd1/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.239870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f830e3a56c444ad8991730093f54c0e4', 'request_id': 'req-680b3492-f448-4b34-bc92-cf2da80124d6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:06.246690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f830e3a56c444ad8991730093f54c0e4', 'request_id': 'req-680b3492-f448-4b34-bc92-cf2da80124d6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:06.246824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3430a598e9564ab3b13eb669c65d52ef, user_id=7542a3de97844dc19c5cb96a55e21fd1, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.249349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.256480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f830e3a56c444ad8991730093f54c0e4', 'request_id': 'req-680b3492-f448-4b34-bc92-cf2da80124d6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:06.262132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:06.265297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1367/2695] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:06 2022] PUT /identity/v3/projects/3430a598e9564ab3b13eb669c65d52ef/users/7542a3de97844dc19c5cb96a55e21fd1/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:06.268337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] The token cache is being invalidate because project f830e3a56c444ad8991730093f54c0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:06.268653 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:06.269370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-680b3492-f448-4b34-bc92-cf2da80124d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:06.269839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.270986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1329/2696] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:06 2022] DELETE /identity/v3/projects/f830e3a56c444ad8991730093f54c0e4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:06.275028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:06.276335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0244e5-31ae-4a54-9342-c1fae2a1baaa None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.276626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0244e5-31ae-4a54-9342-c1fae2a1baaa None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.276901 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0244e5-31ae-4a54-9342-c1fae2a1baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.295907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0d0244e5-31ae-4a54-9342-c1fae2a1baaa None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:06.297110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0d0244e5-31ae-4a54-9342-c1fae2a1baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:06.336551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d2eee-a712-4726-9fe3-68e9e5ae1fa3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.341386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.341982 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.342263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.342538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.342829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:06.343263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.344951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.355405 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1368/2697] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:06.365223 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1330/2698] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:06.365389 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.367266 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.367554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.367832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.370126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af14a-2286-4ec8-8a51-83e2654b6444 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.374994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.375664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.375947 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.376254 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] PATH_INFO: `/v3/projects/3430a598e9564ab3b13eb669c65d52ef/users/7542a3de97844dc19c5cb96a55e21fd1/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.378796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3430a598e9564ab3b13eb669c65d52ef, user_id=7542a3de97844dc19c5cb96a55e21fd1, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.381449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.389123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:06.390329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:06.391685 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1369/2699] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:06 2022] PUT /identity/v3/projects/3430a598e9564ab3b13eb669c65d52ef/users/7542a3de97844dc19c5cb96a55e21fd1/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:06.452502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1331/2700] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:06.456696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.468327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdeba-ac6d-4970-888f-26ee06ef3ab5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.473978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.474568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.474879 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.475142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.475779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:57:06.476083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.477671 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.490678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1370/2701] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:57:06.494803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.504641 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f70e8-5b49-4e69-aa62-464af8f5c64e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.509830 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.510368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.510677 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.510956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.511700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.513626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.543639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1332/2702] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:57:06.548115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.559228 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbdb7-ba9b-4c5f-92bb-9732406e7883 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.618751 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.619360 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.619637 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.619908 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.620525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.622432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.645217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1371/2703] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:06.649427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.660796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28a35-4fd7-4dfe-b675-0ebdfbe7a090 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.665574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.666175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.666856 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.667130 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.667775 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.669357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.680393 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1333/2704] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:06.684361 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.695511 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337cedd-96a8-4754-9dbb-37997c7afdef admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.700611 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5126eb-e438-43c3-9e7f-2e95d07f7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.701213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5126eb-e438-43c3-9e7f-2e95d07f7caf admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.701522 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5126eb-e438-43c3-9e7f-2e95d07f7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.701795 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5126eb-e438-43c3-9e7f-2e95d07f7caf admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.702432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5126eb-e438-43c3-9e7f-2e95d07f7caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.704055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5126eb-e438-43c3-9e7f-2e95d07f7caf admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.714884 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1372/2705] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:06.719092 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.729624 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38724d0-5861-408b-a3c6-3d968e762759 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.734321 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.735010 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.735292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.735570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] PATH_INFO: `/v3/projects/cc30b84244524f12bef7ce136a13df55/users/b2e5951d49ff4616a79030d249c03fd9/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.751343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc30b84244524f12bef7ce136a13df55, user_id=b2e5951d49ff4616a79030d249c03fd9, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.754017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:06.767454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1334/2706] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:06 2022] PUT /identity/v3/projects/cc30b84244524f12bef7ce136a13df55/users/b2e5951d49ff4616a79030d249c03fd9/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:06.777679 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.777963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.778234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.806002 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] MFA Rules not processed for user `b2e5951d49ff4616a79030d249c03fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:06.807247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:06.854279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:06.889907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1373/2707] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:06.894723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:06.970258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fca78-3759-45f9-81a2-bb32f6d6f010 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:06.976614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:06.978317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:06.978317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:06.978317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:06.978664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:06.980973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.022724 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1335/2708] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:06 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:07.024226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.036219 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19a83-d6a3-49ab-9fea-3a502b78e71b None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.098423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.099448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.099915 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.100811 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.101455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.103410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.132022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1374/2709] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:07 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:07.132681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.144464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f868cc-1501-4062-a0b0-d4e317d44757 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.152676 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.153397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.153739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.154080 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.155142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.156959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.174654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1336/2710] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:57:07.178289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.189106 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2981e4-0d99-41b7-b5d6-aa53caca3336 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.199660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d857b6-052d-4230-8f77-726dd3a60d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.200469 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d857b6-052d-4230-8f77-726dd3a60d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.200827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d857b6-052d-4230-8f77-726dd3a60d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.201181 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d857b6-052d-4230-8f77-726dd3a60d13 admin admin] PATH_INFO: `/v3/projects/b0a2637848da4da5811a110245d14ed7/users/288dccad11554923bc0a046f5eb6b782/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.218214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d857b6-052d-4230-8f77-726dd3a60d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a2637848da4da5811a110245d14ed7, user_id=288dccad11554923bc0a046f5eb6b782, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.221231 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d857b6-052d-4230-8f77-726dd3a60d13 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.239961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1375/2711] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:07 2022] PUT /identity/v3/projects/b0a2637848da4da5811a110245d14ed7/users/288dccad11554923bc0a046f5eb6b782/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:07.243700 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.254834 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14720f0-6906-4b73-8a45-f1aa54470fa5 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.262032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:07.285874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.286160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.286437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.332981 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] MFA Rules not processed for user `7542a3de97844dc19c5cb96a55e21fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:07.335011 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.335293 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:07.336408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.336849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.337199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.338006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.339801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.352864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1337/2712] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:57:07.357056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.371779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954831-f581-456c-9d68-530ee0101bad admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.377741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780715fb-2a3c-48d9-a5b1-7f7d301f1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.379145 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780715fb-2a3c-48d9-a5b1-7f7d301f1dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.379629 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780715fb-2a3c-48d9-a5b1-7f7d301f1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.380067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780715fb-2a3c-48d9-a5b1-7f7d301f1dfe admin admin] PATH_INFO: `/v3/projects/b0a2637848da4da5811a110245d14ed7/users/288dccad11554923bc0a046f5eb6b782/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.382398 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780715fb-2a3c-48d9-a5b1-7f7d301f1dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a2637848da4da5811a110245d14ed7, user_id=288dccad11554923bc0a046f5eb6b782, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.385696 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780715fb-2a3c-48d9-a5b1-7f7d301f1dfe admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.398281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1338/2713] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:07 2022] PUT /identity/v3/projects/b0a2637848da4da5811a110245d14ed7/users/288dccad11554923bc0a046f5eb6b782/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:07.409474 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.409849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.410511 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.420018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1376/2714] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:07.434308 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.436088 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:07.442154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] MFA Rules not processed for user `288dccad11554923bc0a046f5eb6b782`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:07.443656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:07.471493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:07.502398 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343829-c2f2-407b-9f06-bdc037253ad0 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.531197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1339/2715] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:07.544018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:07.545782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:07.567925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.568531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.568805 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.569092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.571710 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:07.619421 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941e3d7-550b-430b-a8a4-8bc27e9526ba None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:07.623226 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:07.623841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:07.624127 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:07.624408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:07.636723 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.639183 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.649923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1377/2716] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:07.669728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:07.702883 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:07.704343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:07.715176 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1340/2717] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:57:09.063318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:09.072286 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563be09-6f9a-463d-bf4b-ff9cbfee1215 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:09.075799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:09.076385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:09.076661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:09.076930 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:09.135548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:09.136992 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:09.146413 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1378/2718] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:14.256335 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:14.265397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44636a-b877-4065-86b6-ef36e1994a0d service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:14.270119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bbdd8-0008-4522-9cf1-51620485ccaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:14.270842 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbdd8-0008-4522-9cf1-51620485ccaf service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:14.271192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbdd8-0008-4522-9cf1-51620485ccaf service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:14.271542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbdd8-0008-4522-9cf1-51620485ccaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:14.281180 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bbdd8-0008-4522-9cf1-51620485ccaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:14.282674 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bbdd8-0008-4522-9cf1-51620485ccaf service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:14.292618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1341/2719] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:19.142125 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=85 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:23.404816 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:23.464641 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddfe6e-f344-4e92-b819-322aefa1c432 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:23.469049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:23.469662 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:23.469937 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:23.470207 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] PATH_INFO: `/v3/users/b2e5951d49ff4616a79030d249c03fd9` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:23.471318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e5951d49ff4616a79030d249c03fd9)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:23.474318 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:23.515090 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:23.515601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:23.515815 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:23.527841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e5951d49ff4616a79030d249c03fd9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:23.535562 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e5951d49ff4616a79030d249c03fd9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:23.536120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] MFA Rules not processed for user `bdbf4f974f1747188e46c85a3601124a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:23.537343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:23.543016 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e5951d49ff4616a79030d249c03fd9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:23.555504 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e5951d49ff4616a79030d249c03fd9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:23.556159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2bce925-1f8d-4d23-ae2b-d5157ea4bb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e5951d49ff4616a79030d249c03fd9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:23.562090 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1379/2720] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:23 2022] DELETE /identity/v3/users/b2e5951d49ff4616a79030d249c03fd9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:23.567169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:23.567449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:23.567715 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:23.586552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:23.587693 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:23.604712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1342/2721] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:23.662058 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1380/2722] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:23.667494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:23.668887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:23.729673 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a67c1b-bc90-401b-8edc-aef5f688f740 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:23.783189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:23.783799 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:23.784108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:23.784384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:23.793913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:23.795373 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:23.805139 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1343/2723] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:24.095919 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:24.098055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:24.115619 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193a229-4da2-4350-b454-cf8101ef1ca2 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:24.121295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:24.121801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:24.122078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:24.122388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] PATH_INFO: `/v3/projects/cc30b84244524f12bef7ce136a13df55` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:24.123506 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc30b84244524f12bef7ce136a13df55)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:24.125376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:24.146971 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:24.195252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc30b84244524f12bef7ce136a13df55', 'request_id': 'req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.202149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc30b84244524f12bef7ce136a13df55', 'request_id': 'req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.212036 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc30b84244524f12bef7ce136a13df55', 'request_id': 'req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.224826 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] The token cache is being invalidate because project cc30b84244524f12bef7ce136a13df55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:24.225122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.225815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.227570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1381/2724] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:24 2022] DELETE /identity/v3/projects/cc30b84244524f12bef7ce136a13df55 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:24.231597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:24.241847 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b52afb-4601-4d63-b982-a4c05284a8a5 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:24.261732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:24.302088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:24.302767 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:24.303030 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:24.303300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] PATH_INFO: `/v3/users/288dccad11554923bc0a046f5eb6b782` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:24.304407 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288dccad11554923bc0a046f5eb6b782)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:24.306299 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:24.365522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288dccad11554923bc0a046f5eb6b782'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.374984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288dccad11554923bc0a046f5eb6b782'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.392125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288dccad11554923bc0a046f5eb6b782'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.400529 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288dccad11554923bc0a046f5eb6b782'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.401287 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5fa88ca0-4c20-4079-ae5d-fcb5b92f7c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288dccad11554923bc0a046f5eb6b782'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.407675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1344/2725] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:24 2022] DELETE /identity/v3/users/288dccad11554923bc0a046f5eb6b782 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:24.722895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:24.725414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:24.743680 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1c68d-cd4e-4c22-8a79-97e41702a0e3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:24.809009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:24.809656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:24.809988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:24.810388 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] PATH_INFO: `/v3/projects/b0a2637848da4da5811a110245d14ed7` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:24.811740 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a2637848da4da5811a110245d14ed7)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:24.814001 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:24.870809 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a2637848da4da5811a110245d14ed7', 'request_id': 'req-2408560c-db16-4fb7-8fe1-22cff77d24a7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.877437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a2637848da4da5811a110245d14ed7', 'request_id': 'req-2408560c-db16-4fb7-8fe1-22cff77d24a7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.885066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a2637848da4da5811a110245d14ed7', 'request_id': 'req-2408560c-db16-4fb7-8fe1-22cff77d24a7'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.896023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] The token cache is being invalidate because project b0a2637848da4da5811a110245d14ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:24.896313 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.896942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2408560c-db16-4fb7-8fe1-22cff77d24a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:24.898410 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1382/2726] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:24 2022] DELETE /identity/v3/projects/b0a2637848da4da5811a110245d14ed7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:24.904481 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:24.905620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:24.905907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:24.929261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:24.930476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:24.992205 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1345/2727] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:25.001478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.001766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.002102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.025132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:25.026342 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:25.035248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1383/2728] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:25.041364 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.052078 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917a35-a7f4-4c12-812d-18bf3caf19a1 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.057467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.058143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.058475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.058801 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.059468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:57:25.059784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.061379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.078840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1346/2729] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:57:25.084061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.094220 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68f6fb-78cd-4b60-83d1-4003c3e96bf4 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.100044 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.101178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.101493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.101762 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.102628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.104553 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.132053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1384/2730] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:25 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:25.136088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.146691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c27f-34a4-4167-b863-a49da1b6a139 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.172640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:25.207052 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.207711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.207974 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.208243 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.208936 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.211165 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.233218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1347/2731] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:25 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:57:25.237011 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.243834 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:25.249083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e756-9089-4455-a708-bf3095a0bfda admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.255573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.256244 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.256871 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.257400 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.258066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.259804 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.276382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1385/2732] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:25.277909 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.293557 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993db40a-1e3c-4fca-a0ed-daa65f88dc76 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.299597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2907-be99-419b-9636-1b58605cf0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.300224 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2907-be99-419b-9636-1b58605cf0ef admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.300507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2907-be99-419b-9636-1b58605cf0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.300918 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2907-be99-419b-9636-1b58605cf0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.301579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb2907-be99-419b-9636-1b58605cf0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.303291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb2907-be99-419b-9636-1b58605cf0ef admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.315933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1348/2733] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:25.320897 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.332530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151c02-0049-423e-9b9d-8e8957da4fcc admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.337354 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.338020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.338301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.338578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] PATH_INFO: `/v3/projects/679985a72f3643c9910d6a4d0cd3bfe6/users/377ffede9ce349edab51fd173e9e3353/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.356191 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] RBAC: Authorizing `identity:create_grant(project_id=679985a72f3643c9910d6a4d0cd3bfe6, user_id=377ffede9ce349edab51fd173e9e3353, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.359585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.374390 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1386/2734] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:25 2022] PUT /identity/v3/projects/679985a72f3643c9910d6a4d0cd3bfe6/users/377ffede9ce349edab51fd173e9e3353/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:25.387467 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.387995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.388475 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.438828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] MFA Rules not processed for user `377ffede9ce349edab51fd173e9e3353`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:25.440040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:25.504855 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1349/2735] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:25.515799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:25.517466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:25.575940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dbd10-0cda-47f7-92b7-7bc7e633910a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:25.579709 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:25.580312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:25.580654 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:25.581496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:25.589957 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:25.591404 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:25.600887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1387/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:32.142187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:32.145339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:32.218488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf2560-ae13-4eb5-847a-030c739e9652 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:32.223787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:32.224387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:32.224687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:32.224986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] PATH_INFO: `/v3/users/b51c63c868854bee936154d27628b02d` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:32.226100 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51c63c868854bee936154d27628b02d)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:32.228185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:32.271175 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:32.280348 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51c63c868854bee936154d27628b02d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.289962 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51c63c868854bee936154d27628b02d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.306671 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51c63c868854bee936154d27628b02d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.314262 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51c63c868854bee936154d27628b02d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.314996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51c63c868854bee936154d27628b02d'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.322017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1350/2737] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:32 2022] DELETE /identity/v3/users/b51c63c868854bee936154d27628b02d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:32.500387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:32.513073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98f364-7c3f-406b-b9d1-50a6b65a5aa8 service cinder] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:32.575559 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:32.576186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:32.576461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:32.576728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] PATH_INFO: `/v3/projects/38b82aee03a5478db300ef4475b372e8` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:32.577836 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b82aee03a5478db300ef4475b372e8)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:32.579796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:32.627714 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b82aee03a5478db300ef4475b372e8', 'request_id': 'req-b4517712-3454-40ea-8d31-ee2771976c4a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.639730 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b82aee03a5478db300ef4475b372e8', 'request_id': 'req-b4517712-3454-40ea-8d31-ee2771976c4a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.652602 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b82aee03a5478db300ef4475b372e8', 'request_id': 'req-b4517712-3454-40ea-8d31-ee2771976c4a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.663401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] The token cache is being invalidate because project 38b82aee03a5478db300ef4475b372e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:32.663791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.664484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.666047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1388/2738] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:32 2022] DELETE /identity/v3/projects/38b82aee03a5478db300ef4475b372e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:32.669945 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:32.671465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:32.685405 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4b714-6be3-40dd-84e8-506439832578 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:32.744028 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:32.744594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:32.744874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:32.745149 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] PATH_INFO: `/v3/users/7542a3de97844dc19c5cb96a55e21fd1` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:32.746414 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7542a3de97844dc19c5cb96a55e21fd1)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:32.748592 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:32.798486 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7542a3de97844dc19c5cb96a55e21fd1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.807422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7542a3de97844dc19c5cb96a55e21fd1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.820232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7542a3de97844dc19c5cb96a55e21fd1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.827007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7542a3de97844dc19c5cb96a55e21fd1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.827716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7542a3de97844dc19c5cb96a55e21fd1'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:32.834497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1351/2739] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:32 2022] DELETE /identity/v3/users/7542a3de97844dc19c5cb96a55e21fd1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:33.008599 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.010072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.018246 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:33.032831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517712-3454-40ea-8d31-ee2771976c4a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.059556 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.061155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.100178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.100748 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.101028 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.101311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] PATH_INFO: `/v3/projects/3430a598e9564ab3b13eb669c65d52ef` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.102477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3430a598e9564ab3b13eb669c65d52ef)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.104563 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.114549 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:33.146811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e52c0-9f28-49f8-b38b-ecf84d3c2cb4 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.154988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.155642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.155982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.156265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] PATH_INFO: `/v3/users/377ffede9ce349edab51fd173e9e3353` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.157522 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377ffede9ce349edab51fd173e9e3353)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.160192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.174774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3430a598e9564ab3b13eb669c65d52ef', 'request_id': 'req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.182829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3430a598e9564ab3b13eb669c65d52ef', 'request_id': 'req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.191958 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3430a598e9564ab3b13eb669c65d52ef', 'request_id': 'req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.206392 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] The token cache is being invalidate because project 3430a598e9564ab3b13eb669c65d52ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:33.206711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.207678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-6e99c3b9-7e4a-4401-9d23-6c8c6008f01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.212646 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1389/2740] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:33 2022] DELETE /identity/v3/projects/3430a598e9564ab3b13eb669c65d52ef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:33.214297 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf271-a590-43d6-8181-6af24bd5827c None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.214580 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf271-a590-43d6-8181-6af24bd5827c None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.214876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf271-a590-43d6-8181-6af24bd5827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.236082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377ffede9ce349edab51fd173e9e3353'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.239758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7a1bf271-a590-43d6-8181-6af24bd5827c None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:33.241111 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7a1bf271-a590-43d6-8181-6af24bd5827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.244836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377ffede9ce349edab51fd173e9e3353'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.258111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377ffede9ce349edab51fd173e9e3353'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.265480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377ffede9ce349edab51fd173e9e3353'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.266208 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-2baf0fac-2810-4b6d-a4f0-c3da01a13e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377ffede9ce349edab51fd173e9e3353'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:33.277230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1352/2741] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:33 2022] DELETE /identity/v3/users/377ffede9ce349edab51fd173e9e3353 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:33.278755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.279111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.279395 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.311241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1390/2742] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:33.318833 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:33.319084 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.319439 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.319864 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.320081 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.341778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:33.343687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.387487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:33.427411 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1391/2743] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:33.427541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1353/2744] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:33.431285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.437743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.442314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.443697 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745b9e2-7f32-4d54-98c6-253efaa372f7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.451261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.452331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.452331 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.452526 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.453049 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:57:33.453349 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.457412 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.470055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1392/2745] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:57:33.475102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.490147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ca8b-73cd-479d-897a-ba9252f6368a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.495074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.495807 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.496093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.496530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.497378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.499496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.533982 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36578134-2acd-4bc6-ae01-47abd3903b8e None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.538201 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.538985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.539320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.539639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.541055 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1393/2746] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:33 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:57:33.545615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.557968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.559627 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.566185 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:33.580248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1354/2747] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:57:33.623831 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b5f1-6b1b-4884-8d14-d5c8baae40c5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.633625 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.634260 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.634847 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.635211 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.636195 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.638545 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.678019 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1394/2748] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:33 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:33.679790 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.693524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d30530-16a8-49db-8ea4-267a328a1b39 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.699682 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.700291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.700577 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.701402 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.701548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.703343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.716738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1355/2749] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:33.720901 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.757518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a2bf-f301-4577-9752-62617c6b5a52 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.766892 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.767578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.767870 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.768152 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.769428 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.771009 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.782427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1395/2750] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:33.787094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.800350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d637-84e1-48ac-8c43-62fce83dfc2c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.806075 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91651-7e85-4ada-a96f-fed01cedc5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.806976 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91651-7e85-4ada-a96f-fed01cedc5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.807685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91651-7e85-4ada-a96f-fed01cedc5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.807685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91651-7e85-4ada-a96f-fed01cedc5b4 admin admin] PATH_INFO: `/v3/projects/85961a87cddd45a6997cc3872791f37b/users/5cc98ead5388424ba066f4c3b720b3e9/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.830258 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91651-7e85-4ada-a96f-fed01cedc5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85961a87cddd45a6997cc3872791f37b, user_id=5cc98ead5388424ba066f4c3b720b3e9, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.834415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91651-7e85-4ada-a96f-fed01cedc5b4 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.858983 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1356/2751] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:33 2022] PUT /identity/v3/projects/85961a87cddd45a6997cc3872791f37b/users/5cc98ead5388424ba066f4c3b720b3e9/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:33.904512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.908051 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.918213 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.918505 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.918831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.928312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45112f-2463-4730-8cd4-7dfd76f44c17 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.951686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] MFA Rules not processed for user `5cc98ead5388424ba066f4c3b720b3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:33.952911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.004848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.005493 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.005776 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.006078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] PATH_INFO: `/v3/projects/679985a72f3643c9910d6a4d0cd3bfe6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.007222 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679985a72f3643c9910d6a4d0cd3bfe6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.009149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.034850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1357/2752] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:34.038800 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.044636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.046255 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.071053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679985a72f3643c9910d6a4d0cd3bfe6', 'request_id': 'req-f2871cd8-5384-4e66-b390-fc88cf65f3f1'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:34.078534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679985a72f3643c9910d6a4d0cd3bfe6', 'request_id': 'req-f2871cd8-5384-4e66-b390-fc88cf65f3f1'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:34.086961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679985a72f3643c9910d6a4d0cd3bfe6', 'request_id': 'req-f2871cd8-5384-4e66-b390-fc88cf65f3f1'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:34.101284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] The token cache is being invalidate because project 679985a72f3643c9910d6a4d0cd3bfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:34.101785 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:34.102694 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2871cd8-5384-4e66-b390-fc88cf65f3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:34.104872 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1396/2753] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:33 2022] DELETE /identity/v3/projects/679985a72f3643c9910d6a4d0cd3bfe6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:34.112043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186203c-8583-42b6-b0f8-445c29f037c5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.112351 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186203c-8583-42b6-b0f8-445c29f037c5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.112794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186203c-8583-42b6-b0f8-445c29f037c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.120862 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892de0-b782-469f-897f-06ec7cb053ff None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.133073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6186203c-8583-42b6-b0f8-445c29f037c5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:34.134366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6186203c-8583-42b6-b0f8-445c29f037c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.175607 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.176236 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.176487 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.176761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.179461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.204400 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.209621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1397/2754] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:57:34.211366 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.211664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.212003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.234003 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:34.235247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.244221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1398/2755] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:34.248304 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.248643 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.249739 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.259933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1358/2756] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:34.260132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e09107-55cf-4885-af1b-ea9888d7958f None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.265418 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.266309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.266763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.267136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.267895 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:57:34.268373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.270541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.287977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1399/2757] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:57:34.291544 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.302776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b7142-a220-47cf-b718-180c379f046f service glance] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.307573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.308181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.308465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.308741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.309363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.311343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.343232 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1359/2758] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:34 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:34.347097 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.356794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c9892-ebc7-40db-8bda-d3d5ca86c0a3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.416745 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.417362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.417648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.417924 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.418555 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.420484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.445126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1400/2759] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:34 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:34.446526 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.457662 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29694c-5dd1-46de-9416-e4099ed16789 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.462535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.463260 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.463620 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.463895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.464537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.466119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.477628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1360/2760] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:34.481705 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.493022 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f971f3-25a6-41b9-bc55-cff2da018b5a admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.498087 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc39e3-1296-4159-ab19-472387180181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.498724 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc39e3-1296-4159-ab19-472387180181 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.499026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc39e3-1296-4159-ab19-472387180181 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.499279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc39e3-1296-4159-ab19-472387180181 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.499916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc39e3-1296-4159-ab19-472387180181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.501507 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc39e3-1296-4159-ab19-472387180181 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.512594 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1401/2761] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:34.516625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.527313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e224f10-e199-4f06-b0d3-ca78907fb5ef admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.532493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.533372 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.533524 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.533950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] PATH_INFO: `/v3/projects/5d7e732ce9de486f90f006e094006fc6/users/3d421fcedd8944ffb9f50fac10a99bc0/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.552870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7e732ce9de486f90f006e094006fc6, user_id=3d421fcedd8944ffb9f50fac10a99bc0, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.557409 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.604196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1361/2762] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:34 2022] PUT /identity/v3/projects/5d7e732ce9de486f90f006e094006fc6/users/3d421fcedd8944ffb9f50fac10a99bc0/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:34.615350 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.615846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.615946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.630241 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:34.649758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] MFA Rules not processed for user `3d421fcedd8944ffb9f50fac10a99bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:34.651750 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.759135 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1402/2763] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:34.775507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:34.777444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:34.842504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95647dba-6111-4973-a970-508cf9267b45 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:34.846169 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57271f9a-3f6f-4ca9-8e94-a13f4c8dced8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:34.846844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57271f9a-3f6f-4ca9-8e94-a13f4c8dced8 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:34.847125 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57271f9a-3f6f-4ca9-8e94-a13f4c8dced8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:34.847396 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57271f9a-3f6f-4ca9-8e94-a13f4c8dced8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:34.856346 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57271f9a-3f6f-4ca9-8e94-a13f4c8dced8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:34.857769 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57271f9a-3f6f-4ca9-8e94-a13f4c8dced8 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:34.867322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1362/2764] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:39.541578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:39.604912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fa203-afac-4604-b10c-01c5d57addb3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:39.609441 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:39.610065 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:39.610341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:39.610652 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] PATH_INFO: `/v3/users/3d421fcedd8944ffb9f50fac10a99bc0` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:39.611773 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d421fcedd8944ffb9f50fac10a99bc0)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:39.613678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:39.673725 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d421fcedd8944ffb9f50fac10a99bc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:39.682042 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d421fcedd8944ffb9f50fac10a99bc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:39.690099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d421fcedd8944ffb9f50fac10a99bc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:39.711295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d421fcedd8944ffb9f50fac10a99bc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:39.712965 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d421fcedd8944ffb9f50fac10a99bc0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:39.720188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1403/2765] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:39 2022] DELETE /identity/v3/users/3d421fcedd8944ffb9f50fac10a99bc0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:39.725152 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:39.725621 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:39.725861 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:39.747319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:39.748541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:39.807585 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1363/2766] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:39.817775 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:39.819832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:39.838943 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:39.881763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b73e3-f027-4350-8d8e-ef265372a0e3 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:39.885537 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f0a81-0036-4317-ad4b-f8ae2b87544d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:39.886145 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0a81-0036-4317-ad4b-f8ae2b87544d service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:39.886427 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0a81-0036-4317-ad4b-f8ae2b87544d service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:39.886739 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0a81-0036-4317-ad4b-f8ae2b87544d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:39.895489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f0a81-0036-4317-ad4b-f8ae2b87544d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:39.896923 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f0a81-0036-4317-ad4b-f8ae2b87544d service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:39.906126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1404/2767] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:40.194196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.195644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:40.219159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de7fd-6cb5-4b76-be2d-5b1ddafc4ef0 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.227900 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.228601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.228887 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.229161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] PATH_INFO: `/v3/projects/5d7e732ce9de486f90f006e094006fc6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.230301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7e732ce9de486f90f006e094006fc6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.232265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.234847 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:40.291720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7e732ce9de486f90f006e094006fc6', 'request_id': 'req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:40.305242 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7e732ce9de486f90f006e094006fc6', 'request_id': 'req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:40.320913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7e732ce9de486f90f006e094006fc6', 'request_id': 'req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:40.333443 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] The token cache is being invalidate because project 5d7e732ce9de486f90f006e094006fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:57:40.333679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:40.334248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-4dcd89b8-4229-4b1e-bf13-6a65ec438f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:57:40.336019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1364/2768] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:57:40 2022] DELETE /identity/v3/projects/5d7e732ce9de486f90f006e094006fc6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:40.341066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.341352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.341661 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.362479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:40.363678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:40.422132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1405/2769] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:40.431729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.432019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.432297 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.452693 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:40.453913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:40.461964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1365/2770] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:40.466289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.476296 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad622-6df3-486c-b81c-f469a8af69fb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.481167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.481760 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.482041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.482317 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.483186 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:57:40.483491 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.485367 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.498321 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1406/2771] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:57:40.502736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.511944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63595ef6-f322-4ebb-be12-1892e0318c22 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.516630 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.517252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.517533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.517808 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.518427 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.520358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.548867 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1366/2772] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:40 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:40.553039 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.562986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fead4-2878-4185-a962-3ca2a345191c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.621387 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.621993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.622268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.622538 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.623192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.625161 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.648615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1407/2773] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:40 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:40.653089 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.664761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223140-b7f8-4afc-aff0-874c2f0dda30 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.669370 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.669997 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.670280 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.670553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.671341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.672984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.682573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1367/2774] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:40.686720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.697551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c1bef-ceb3-4246-979e-303bbd693579 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.702496 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e466a1-7135-4a13-b399-8b8c638f42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.703292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e466a1-7135-4a13-b399-8b8c638f42b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.703575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e466a1-7135-4a13-b399-8b8c638f42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.703845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e466a1-7135-4a13-b399-8b8c638f42b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.704485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e466a1-7135-4a13-b399-8b8c638f42b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.706077 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e466a1-7135-4a13-b399-8b8c638f42b8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.717368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1408/2775] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:40.721686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.732459 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e39fb-84d1-4ce4-8260-300ff3c3e66a admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.737765 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.738550 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.738864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.739143 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] PATH_INFO: `/v3/projects/42c8262170e04920ae36e89e24656f7d/users/4974aee8a8724bcd8278cd1fc8736b05/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.755755 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c8262170e04920ae36e89e24656f7d, user_id=4974aee8a8724bcd8278cd1fc8736b05, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.758448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.773105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1368/2776] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:40 2022] PUT /identity/v3/projects/42c8262170e04920ae36e89e24656f7d/users/4974aee8a8724bcd8278cd1fc8736b05/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:40.778171 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78cda-bf47-4e12-b054-d212ed4fd68e None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.778472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78cda-bf47-4e12-b054-d212ed4fd68e None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.778823 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78cda-bf47-4e12-b054-d212ed4fd68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.798449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-c1d78cda-bf47-4e12-b054-d212ed4fd68e None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:40.799664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c1d78cda-bf47-4e12-b054-d212ed4fd68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:40.818101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:40.863475 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1409/2777] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:40.876469 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:40.878117 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:40.951872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a5a4-00f9-451b-9fd5-8783c4fb5a5e admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:40.955889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bc7d2-c512-499c-b834-df1cd2cff962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:40.956504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc7d2-c512-499c-b834-df1cd2cff962 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:40.956789 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc7d2-c512-499c-b834-df1cd2cff962 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:40.957067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bc7d2-c512-499c-b834-df1cd2cff962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:40.967614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bc7d2-c512-499c-b834-df1cd2cff962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:40.969039 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bc7d2-c512-499c-b834-df1cd2cff962 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:40.978548 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1369/2778] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:43.459696 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:43.460230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:43.460230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:43.505512 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] MFA Rules not processed for user `10ddb84a8b734c70b7b55685a1a12f95`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:43.509629 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:43.701963 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1410/2779] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:45.716038 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:45.716606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:45.716606 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:45.756369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] MFA Rules not processed for user `4974aee8a8724bcd8278cd1fc8736b05`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:45.757645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:45.798019 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:45.899949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1370/2780] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:45.905142 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:45.980239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9feae8-1187-480e-aa81-b7c5a4902698 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:45.985234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:45.985855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:45.986139 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:45.986414 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:45.987155 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:45.989253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:46.056970 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1411/2781] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:57:45 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:57:46.058154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:46.078698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e2662-e7ae-4246-b5a1-5dc395025696 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:46.157595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:46.158289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:46.158576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:46.159211 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:46.159986 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:46.163007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:46.195279 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1371/2782] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:57:46 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:57:46.196495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:46.210192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9b7e-ab33-4028-9bfe-553b735cc739 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:46.215018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:46.215628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:46.216896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:46.216896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:46.216896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:46.218527 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:46.233156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1412/2783] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:57:46.236823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:46.249007 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f10452-a375-4e04-9b0f-9c3f111f948f admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:46.256296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:46.257345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:46.258015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:46.258369 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] PATH_INFO: `/v3/projects/80706aa8833543f4ba57e7199a9dd850/users/6cc8bd3a79524b5f987e914eaf49af6b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:46.284025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80706aa8833543f4ba57e7199a9dd850, user_id=6cc8bd3a79524b5f987e914eaf49af6b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:46.287895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:46.305493 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1372/2784] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:46 2022] PUT /identity/v3/projects/80706aa8833543f4ba57e7199a9dd850/users/6cc8bd3a79524b5f987e914eaf49af6b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:57:46.310005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:46.327832 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d55959-207e-4343-9f5e-ff9f67c2a161 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:46.378535 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:46.417578 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74e95-0e2f-4502-a535-5ce2a6e2ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:46.418325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74e95-0e2f-4502-a535-5ce2a6e2ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:46.418631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74e95-0e2f-4502-a535-5ce2a6e2ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:46.418931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74e95-0e2f-4502-a535-5ce2a6e2ef44 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:46.419584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c74e95-0e2f-4502-a535-5ce2a6e2ef44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:46.421543 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c74e95-0e2f-4502-a535-5ce2a6e2ef44 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:46.438170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1413/2785] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:46.442860 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:46.456864 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f647c-7d92-436c-bedc-58490a26bdc2 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:46.462640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:46.463257 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:46.463545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:46.463823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] PATH_INFO: `/v3/projects/80706aa8833543f4ba57e7199a9dd850/users/6cc8bd3a79524b5f987e914eaf49af6b/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:46.465930 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80706aa8833543f4ba57e7199a9dd850, user_id=6cc8bd3a79524b5f987e914eaf49af6b, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:46.468611 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:46.482895 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1373/2786] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:57:46 2022] PUT /identity/v3/projects/80706aa8833543f4ba57e7199a9dd850/users/6cc8bd3a79524b5f987e914eaf49af6b/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:57:52.063328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8a81-2450-44e9-a3df-c4cb8a2f2ca2 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:52.064071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8a81-2450-44e9-a3df-c4cb8a2f2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:52.064167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8a81-2450-44e9-a3df-c4cb8a2f2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:52.094283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-6a8a8a81-2450-44e9-a3df-c4cb8a2f2ca2 None None] MFA Rules not processed for user `6cc8bd3a79524b5f987e914eaf49af6b`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:52.095718 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-6a8a8a81-2450-44e9-a3df-c4cb8a2f2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:52.180889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1414/2787] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:52.195113 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:52.197357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:52.282333 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:52.333729 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fecc3-7105-4e3f-bfe7-f369de77130c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:52.339428 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1c862-dc2b-40e3-8a35-697c0199aa79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:52.340044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1c862-dc2b-40e3-8a35-697c0199aa79 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:52.340326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1c862-dc2b-40e3-8a35-697c0199aa79 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:52.340598 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1c862-dc2b-40e3-8a35-697c0199aa79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:52.404701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1c862-dc2b-40e3-8a35-697c0199aa79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:52.407120 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1c862-dc2b-40e3-8a35-697c0199aa79 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:52.417309 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1374/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:53.442115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:53.443896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:53.444721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:53.473477 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] MFA Rules not processed for user `4974aee8a8724bcd8278cd1fc8736b05`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:53.475091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:53.484043 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1415/2789] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:53.773003 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:53.773712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:53.773712 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:53.790442 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:53.792270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:53.825585 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:53.826793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:53.913679 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1375/2790] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 12 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:53.968461 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c1311-5c55-44cb-a9dd-c15c0afda81a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:53.979426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:53.980893 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:53.981372 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:53.982132 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:53.989195 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:53.991299 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:53.991849 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:54.023459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:54.025401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:54.075514 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1416/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:57:54.086717 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0b988-8345-4b03-9e43-88232659cc23 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:54.102105 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2720c83-eda5-4d50-9ad3-afaf9f8b00ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:54.104916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720c83-eda5-4d50-9ad3-afaf9f8b00ab service swift] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:54.104916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720c83-eda5-4d50-9ad3-afaf9f8b00ab service swift] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:54.104916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720c83-eda5-4d50-9ad3-afaf9f8b00ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:54.116535 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=100 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:54.123715 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2720c83-eda5-4d50-9ad3-afaf9f8b00ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:54.127347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2720c83-eda5-4d50-9ad3-afaf9f8b00ab service swift] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:54.162988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1376/2792] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:57:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:57:59.884217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:59.887886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:59.932851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=100 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:59.987989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e823-8091-4ac4-b075-6f6aef0c8781 service placement] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:59.993240 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:59.993873 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:59.994156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:59.994425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] PATH_INFO: `/v3/users/5cc98ead5388424ba066f4c3b720b3e9` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:59.995577 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc98ead5388424ba066f4c3b720b3e9)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:59.997587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:00.055168 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc98ead5388424ba066f4c3b720b3e9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.069078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc98ead5388424ba066f4c3b720b3e9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.078890 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc98ead5388424ba066f4c3b720b3e9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.097953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc98ead5388424ba066f4c3b720b3e9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.099214 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc98ead5388424ba066f4c3b720b3e9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.110305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1417/2793] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:57:59 2022] DELETE /identity/v3/users/5cc98ead5388424ba066f4c3b720b3e9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:00.114908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:00.115759 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:00.116234 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:00.171317 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:00.173708 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:00.299296 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1377/2794] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:00.311660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:00.313450 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:00.419339 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e543fd8-39d7-4022-83e8-c6e08dac794c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:00.423226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61f6c-cd8a-4583-ba80-3765a24e8f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:00.424010 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61f6c-cd8a-4583-ba80-3765a24e8f99 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:00.424340 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61f6c-cd8a-4583-ba80-3765a24e8f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:00.424628 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61f6c-cd8a-4583-ba80-3765a24e8f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:00.439626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61f6c-cd8a-4583-ba80-3765a24e8f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:00.448206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61f6c-cd8a-4583-ba80-3765a24e8f99 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:00.460151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1418/2795] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:00.778480 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:00.780014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:00.798664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3e967-bf12-4e6f-a324-bac88f328414 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:00.805527 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:00.806159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:00.806455 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:00.806811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] PATH_INFO: `/v3/projects/85961a87cddd45a6997cc3872791f37b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:00.807903 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85961a87cddd45a6997cc3872791f37b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:00.809907 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:00.858991 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85961a87cddd45a6997cc3872791f37b', 'request_id': 'req-908ce81d-78cb-48c6-ab12-86345c81676b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.866147 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85961a87cddd45a6997cc3872791f37b', 'request_id': 'req-908ce81d-78cb-48c6-ab12-86345c81676b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.876465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85961a87cddd45a6997cc3872791f37b', 'request_id': 'req-908ce81d-78cb-48c6-ab12-86345c81676b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.889376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] The token cache is being invalidate because project 85961a87cddd45a6997cc3872791f37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:58:00.889667 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.890329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-908ce81d-78cb-48c6-ab12-86345c81676b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:00.894695 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1378/2796] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:58:00 2022] DELETE /identity/v3/projects/85961a87cddd45a6997cc3872791f37b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:00.897902 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:00.898479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:00.898479 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:00.949451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:00.950663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:00.968071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:01.027584 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1419/2797] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:01.028612 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.028916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.029200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.053640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:01.055204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:01.068971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1379/2798] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:58:01.070249 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.080542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabc7a-1805-4791-9763-a35a47937fd3 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.085686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.086279 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.086552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.086848 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.087541 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:58:01.087850 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.089487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.102648 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1420/2799] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:58:01.106453 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.118066 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be1eca-2ed5-46a9-b5cd-dc5fff1a0483 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.123322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.123893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.124189 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.124470 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.125193 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.127181 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.158432 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1380/2800] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:58:01 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:58:01.162846 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.178455 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e75ac-bc20-43e6-91e4-1adf14c572ce admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.245801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.245801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.245801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.245801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.246356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.248704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.279378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1421/2801] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:58:01 2022] POST /identity/v3/users => generated 281 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:58:01.288562 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.299949 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728d59d-0b24-46a9-af1f-a596816c9393 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.305479 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.306220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.306618 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.307026 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.307793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.309689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.322411 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1381/2802] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:01.327112 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.338790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ecd2-8322-40ab-8c8c-97b39716078f admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.347589 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92a69-b989-4a31-9c53-5c28a8e29049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.348268 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92a69-b989-4a31-9c53-5c28a8e29049 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.348615 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92a69-b989-4a31-9c53-5c28a8e29049 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.348896 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92a69-b989-4a31-9c53-5c28a8e29049 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.350160 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92a69-b989-4a31-9c53-5c28a8e29049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.351783 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92a69-b989-4a31-9c53-5c28a8e29049 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.382074 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1422/2803] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:01.386123 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.396492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d17f4d-f9c1-40f9-849f-87555b67a0ae admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.401644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.402329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.402628 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.402913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] PATH_INFO: `/v3/projects/6c20dd8ff5b64f889111f89086fefcfc/users/149b449c64e748ee9c622168be257fdc/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.426744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c20dd8ff5b64f889111f89086fefcfc, user_id=149b449c64e748ee9c622168be257fdc, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.438639 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.446476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1382/2804] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:58:01 2022] PUT /identity/v3/projects/6c20dd8ff5b64f889111f89086fefcfc/users/149b449c64e748ee9c622168be257fdc/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:01.458395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.458801 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.459020 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.492779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] MFA Rules not processed for user `149b449c64e748ee9c622168be257fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:01.494102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:01.570416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1423/2805] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:01.608445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.610437 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:01.624006 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:01.685644 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2236-2ccd-4652-9ebf-e93de7bfe257 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.699617 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c1b60-a6ad-4766-a649-46ec33466e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.700272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c1b60-a6ad-4766-a649-46ec33466e79 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.700559 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c1b60-a6ad-4766-a649-46ec33466e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.700845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c1b60-a6ad-4766-a649-46ec33466e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.711779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c1b60-a6ad-4766-a649-46ec33466e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.713339 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c1b60-a6ad-4766-a649-46ec33466e79 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.723654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1383/2806] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:01.741352 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:01.765198 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:01.824852 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955d02-c0ff-4e9b-bec4-d5145596216a None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:01.831150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:01.831818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.832092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.832364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] PATH_INFO: `/v3/users/149b449c64e748ee9c622168be257fdc` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.833719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149b449c64e748ee9c622168be257fdc)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:01.835638 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:01.894842 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149b449c64e748ee9c622168be257fdc'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:01.903973 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149b449c64e748ee9c622168be257fdc'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:01.912887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149b449c64e748ee9c622168be257fdc'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:01.928448 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149b449c64e748ee9c622168be257fdc'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:01.929165 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149b449c64e748ee9c622168be257fdc'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:01.936144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1424/2807] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:58:01 2022] DELETE /identity/v3/users/149b449c64e748ee9c622168be257fdc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:58:01.940954 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:01.941248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:01.941558 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:01.965935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:01.967697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:02.039814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1384/2808] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:02.050347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:02.054858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:02.162311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38cfc-b53d-4def-8c1f-40df5c047cf8 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:02.166483 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16a394-afd7-4a80-8810-4355028a1722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:02.167194 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a394-afd7-4a80-8810-4355028a1722 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:02.167423 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a394-afd7-4a80-8810-4355028a1722 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:02.167695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a394-afd7-4a80-8810-4355028a1722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:02.179728 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a394-afd7-4a80-8810-4355028a1722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:02.181301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a394-afd7-4a80-8810-4355028a1722 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:02.192285 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1425/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:02.557293 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:02.559698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:02.581188 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d81a-a5b0-4c5a-9faa-ee4c0ed67bb9 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:02.590468 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:02.591542 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:02.591828 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:02.592272 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] PATH_INFO: `/v3/projects/6c20dd8ff5b64f889111f89086fefcfc` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:02.593353 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c20dd8ff5b64f889111f89086fefcfc)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:02.595357 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:02.658889 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c20dd8ff5b64f889111f89086fefcfc', 'request_id': 'req-04f5677b-1beb-4231-ba5f-53498dcf2882'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:02.669743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c20dd8ff5b64f889111f89086fefcfc', 'request_id': 'req-04f5677b-1beb-4231-ba5f-53498dcf2882'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:02.678318 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c20dd8ff5b64f889111f89086fefcfc', 'request_id': 'req-04f5677b-1beb-4231-ba5f-53498dcf2882'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:02.690341 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] The token cache is being invalidate because project 6c20dd8ff5b64f889111f89086fefcfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:58:02.690642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:02.691306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:02.692848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1385/2810] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:58:02 2022] DELETE /identity/v3/projects/6c20dd8ff5b64f889111f89086fefcfc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:12.187048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:12.686973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:16.641057 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:16.641610 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:16.641757 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:16.660781 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] MFA Rules not processed for user `67819b0ba6554d5980f1c6458f3e98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:16.662072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:16.718600 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1426/2811] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 12 11:58:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:16.730541 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:16.731955 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:16.799545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5677b-1beb-4231-ba5f-53498dcf2882 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:16.805049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64379c68ad5d4aa989691e3dcbdb1900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:16.805681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:16.805961 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:16.806237 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:16.814477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:16.816116 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:16.824656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1386/2812] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 12 11:58:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:58:18.717257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:18.718786 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:18.802093 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff25e2-4361-45c0-95c0-a2dc9923bbd7 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:18.807136 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:18.807961 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:18.808309 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:18.808658 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] PATH_INFO: `/v3/users/bdbf4f974f1747188e46c85a3601124a` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:18.809917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdbf4f974f1747188e46c85a3601124a)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:18.811989 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:18.885913 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdbf4f974f1747188e46c85a3601124a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:18.896645 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdbf4f974f1747188e46c85a3601124a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:18.909179 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdbf4f974f1747188e46c85a3601124a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:18.925433 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdbf4f974f1747188e46c85a3601124a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:18.926531 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-0bcb8c6c-000e-4746-9cfd-7ba929485955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdbf4f974f1747188e46c85a3601124a'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:18.933841 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1427/2813] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:58:18 2022] DELETE /identity/v3/users/bdbf4f974f1747188e46c85a3601124a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:19.260984 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.271419 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f3e92-e671-4e80-83f9-eba2458c12a1 service swift] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.333183 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.333837 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.334118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.334390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] PATH_INFO: `/v3/projects/e5c85fe65feb4b3f890372c8da841629` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.336230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c85fe65feb4b3f890372c8da841629)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.338110 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.387306 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c85fe65feb4b3f890372c8da841629', 'request_id': 'req-a8e0098b-b401-47e0-868a-10de5e881723'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:19.393738 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c85fe65feb4b3f890372c8da841629', 'request_id': 'req-a8e0098b-b401-47e0-868a-10de5e881723'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:19.401265 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c85fe65feb4b3f890372c8da841629', 'request_id': 'req-a8e0098b-b401-47e0-868a-10de5e881723'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:19.411445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] The token cache is being invalidate because project e5c85fe65feb4b3f890372c8da841629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:58:19.411736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:19.412363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-a8e0098b-b401-47e0-868a-10de5e881723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:19.413908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1387/2814] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:58:19 2022] DELETE /identity/v3/projects/e5c85fe65feb4b3f890372c8da841629 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:19.418568 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.418882 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.419154 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.439684 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:19.440886 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:19.459889 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:19.506779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1428/2815] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:19.572326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.572754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.573088 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.595915 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:19.597135 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:19.607291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1388/2816] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:19.612204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.627283 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526d4a2-bd81-4e5f-918d-1e402d6cc5ac None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.633990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.634867 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.635363 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.635766 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.636664 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:58:19.637292 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.640647 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.663395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1429/2817] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:58:19.664555 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.673865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf2594-1469-4696-b479-7300a5d6e67a None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.679958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.680645 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.680985 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.681337 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] PATH_INFO: `/v3/projects` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.682154 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.684142 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.696744 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:19.718652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1389/2818] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:58:19 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:58:19.720325 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.730282 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d967c-d68c-44bb-8e8e-ee74280a4c87 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.786150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.786790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.787073 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.787347 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] PATH_INFO: `/v3/users` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.787988 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.789899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.813692 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1430/2819] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:58:19 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:58:19.815173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.826219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d86d6-ea31-4256-8fef-6d1b707f6427 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.833102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.833709 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.833988 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.834261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.835308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.836554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.846772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1390/2820] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:58:19.850916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.861677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160908-f92b-4707-be6e-ebdc32409793 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.866755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0efe95-f0e6-4ad6-96a6-d2ec8e835687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.867863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0efe95-f0e6-4ad6-96a6-d2ec8e835687 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.868148 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0efe95-f0e6-4ad6-96a6-d2ec8e835687 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.868426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0efe95-f0e6-4ad6-96a6-d2ec8e835687 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.869083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0efe95-f0e6-4ad6-96a6-d2ec8e835687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.874554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0efe95-f0e6-4ad6-96a6-d2ec8e835687 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.882927 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1431/2821] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:19.887336 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:19.898601 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9affaab-d91c-4a40-9aa8-a7a9706926dd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:19.903613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:19.904439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.904803 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.905198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] PATH_INFO: `/v3/projects/5f810a6509744cdab096cee4ad7e9bde/users/dafc9b94ea0a490392a2643b7fe5e9f4/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.921001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f810a6509744cdab096cee4ad7e9bde, user_id=dafc9b94ea0a490392a2643b7fe5e9f4, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:19.923737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:19.937995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1391/2822] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:58:19 2022] PUT /identity/v3/projects/5f810a6509744cdab096cee4ad7e9bde/users/dafc9b94ea0a490392a2643b7fe5e9f4/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:19.948221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:19.948573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:19.948916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:19.983018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] MFA Rules not processed for user `dafc9b94ea0a490392a2643b7fe5e9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:19.984634 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:20.070678 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1432/2823] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:20.082892 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:20.084749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:20.150465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8d37c-0863-4415-b02b-aababd53a7e1 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:20.154448 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1335a28b21342d1afed40e182a524f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:20.155119 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:20.155401 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:20.155668 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:20.165489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:20.166943 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:20.177023 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1392/2824] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:30.067480 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:30.172314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:46.074138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:46.075551 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:46.134966 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cf998-1bca-470b-a747-57c18c1d85e1 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:46.139193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:46.140324 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:46.141113 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:46.141382 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:46.143798 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:46.212635 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:46.214072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:46.224269 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1433/2825] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:55.376492 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:55.378144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:55.443482 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4349561-6640-46de-be77-5a70dc101c51 service glance] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:55.448067 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:55.448685 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.448968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.449244 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] PATH_INFO: `/v3/users/10ddb84a8b734c70b7b55685a1a12f95` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.450368 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ddb84a8b734c70b7b55685a1a12f95)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:55.452311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:55.497501 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ddb84a8b734c70b7b55685a1a12f95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.504654 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ddb84a8b734c70b7b55685a1a12f95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.516347 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ddb84a8b734c70b7b55685a1a12f95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.523156 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ddb84a8b734c70b7b55685a1a12f95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.523793 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-5e9f74ac-8a4a-41ca-9479-bd4cc0286bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ddb84a8b734c70b7b55685a1a12f95'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.530503 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1393/2826] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:58:55 2022] DELETE /identity/v3/users/10ddb84a8b734c70b7b55685a1a12f95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:55.713858 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:55.724449 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529204c-0338-4f49-9116-b7badde9b53b service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:55.790250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:55.790909 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.791187 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.792122 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] PATH_INFO: `/v3/projects/8c66a0584e9345c392d95524bdcc7f16` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.793227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c66a0584e9345c392d95524bdcc7f16)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:55.795196 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:55.841178 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c66a0584e9345c392d95524bdcc7f16', 'request_id': 'req-fa2be48c-6eb6-4252-9f9d-6503ffe32945'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.843018 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:55.847827 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c66a0584e9345c392d95524bdcc7f16', 'request_id': 'req-fa2be48c-6eb6-4252-9f9d-6503ffe32945'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.856099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c66a0584e9345c392d95524bdcc7f16', 'request_id': 'req-fa2be48c-6eb6-4252-9f9d-6503ffe32945'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.872080 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] The token cache is being invalidate because project 8c66a0584e9345c392d95524bdcc7f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:58:55.872305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.872977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fa2be48c-6eb6-4252-9f9d-6503ffe32945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.874820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1434/2827] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:58:55 2022] DELETE /identity/v3/projects/8c66a0584e9345c392d95524bdcc7f16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:55.879995 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.880311 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.880590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.903919 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:55.905215 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:55.968173 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1394/2828] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:55.976845 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.977127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.977395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.996368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:55.997548 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.005484 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1435/2829] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:56.009795 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.020040 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f9021-ccf6-4f85-85c0-9ba7a1330907 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.024691 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.025291 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.025614 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.026410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.027084 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:58:56.027387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.028980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.041091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1395/2830] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:58:56.045631 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.055167 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d20f-a356-42bf-9d1e-4f3652312fa6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.060266 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.060877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.061158 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.061492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.062193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.064218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.093829 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1436/2831] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:58:56 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:58:56.098018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.108137 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc128-6096-40c5-b7e5-a476b1501bda admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.111704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:56.169626 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.170155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.170439 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.170754 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.171397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.173324 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.196725 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1396/2832] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:58:56 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:58:56.201459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.212302 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93578f-5165-4d79-9e46-d34d8e8abf14 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.218626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.219520 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.219940 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.220346 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.221328 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.223876 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.238682 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1437/2833] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:56.243024 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.254698 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22097-7819-4d63-b1d9-eadf794c5ae7 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.259545 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b115eb-299c-42bf-9935-476bcef37506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.260804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b115eb-299c-42bf-9935-476bcef37506 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.261095 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b115eb-299c-42bf-9935-476bcef37506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.261367 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b115eb-299c-42bf-9935-476bcef37506 admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.262020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b115eb-299c-42bf-9935-476bcef37506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.263633 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b115eb-299c-42bf-9935-476bcef37506 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.275002 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1397/2834] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:56.279524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.289877 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532333f1-77f7-4af7-9d9e-4ec2ae313805 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.294552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.295224 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.295502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.295774 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] PATH_INFO: `/v3/projects/0efc1735699c4aef91058b00afce0995/users/a44e166b292642bcb398a612feadd5ff/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.310499 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efc1735699c4aef91058b00afce0995, user_id=a44e166b292642bcb398a612feadd5ff, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.313218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.328138 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1438/2835] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:58:56 2022] PUT /identity/v3/projects/0efc1735699c4aef91058b00afce0995/users/a44e166b292642bcb398a612feadd5ff/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:56.338678 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.339111 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.339394 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.367252 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] MFA Rules not processed for user `a44e166b292642bcb398a612feadd5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:56.368465 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.439190 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1398/2836] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:56.452156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.453839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.531620 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738456b4-2b2c-4618-81ba-0b05f73c975c admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.535312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1324-c5c7-48cb-835d-a6af45114147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.535912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1324-c5c7-48cb-835d-a6af45114147 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.536193 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1324-c5c7-48cb-835d-a6af45114147 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.536473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1324-c5c7-48cb-835d-a6af45114147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.545217 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1324-c5c7-48cb-835d-a6af45114147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.546656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1324-c5c7-48cb-835d-a6af45114147 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.555820 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1439/2837] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:56.699573 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.701379 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.783444 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d852e-936e-4a85-b77e-647f57754c36 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.788570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.789197 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.789478 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.789751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] PATH_INFO: `/v3/users/dafc9b94ea0a490392a2643b7fe5e9f4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.791823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafc9b94ea0a490392a2643b7fe5e9f4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.793794 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.811665 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:56.847757 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafc9b94ea0a490392a2643b7fe5e9f4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:56.857971 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafc9b94ea0a490392a2643b7fe5e9f4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:56.887956 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafc9b94ea0a490392a2643b7fe5e9f4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:56.898913 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafc9b94ea0a490392a2643b7fe5e9f4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:56.899966 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafc9b94ea0a490392a2643b7fe5e9f4'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:56.908082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1399/2838] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:58:56 2022] DELETE /identity/v3/users/dafc9b94ea0a490392a2643b7fe5e9f4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:56.912508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.913230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.913230 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.932985 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:56.934188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.995791 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:57.010583 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1440/2839] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:57.017091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.019247 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:57.085476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f8a8-337a-4f5e-aea3-704273a6ac24 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.089680 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff12bc-fbc9-4511-b889-2d9418911da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.090290 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff12bc-fbc9-4511-b889-2d9418911da1 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.090570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff12bc-fbc9-4511-b889-2d9418911da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.090875 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff12bc-fbc9-4511-b889-2d9418911da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.099980 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff12bc-fbc9-4511-b889-2d9418911da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.101397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff12bc-fbc9-4511-b889-2d9418911da1 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.111476 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1400/2840] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:57.372502 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.374017 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:57.394232 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbcf4-01d6-468d-b864-9dfd71d60a74 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.399271 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.400120 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.401227 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.401576 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] PATH_INFO: `/v3/projects/5f810a6509744cdab096cee4ad7e9bde` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.402721 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f810a6509744cdab096cee4ad7e9bde)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.404626 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.452102 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f810a6509744cdab096cee4ad7e9bde', 'request_id': 'req-4397a69c-347e-41dd-925d-3a205e4e1744'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.458075 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f810a6509744cdab096cee4ad7e9bde', 'request_id': 'req-4397a69c-347e-41dd-925d-3a205e4e1744'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.465668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f810a6509744cdab096cee4ad7e9bde', 'request_id': 'req-4397a69c-347e-41dd-925d-3a205e4e1744'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.475722 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] The token cache is being invalidate because project 5f810a6509744cdab096cee4ad7e9bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:58:57.476005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.476617 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-4397a69c-347e-41dd-925d-3a205e4e1744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.478060 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1441/2841] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:58:57 2022] DELETE /identity/v3/projects/5f810a6509744cdab096cee4ad7e9bde => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:57.482911 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.483390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.483510 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.502380 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:57.503602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:57.564796 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1401/2842] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:57.578144 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.578451 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.578754 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.599642 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:57.600843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:57.608869 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1442/2843] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:57.613049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.622554 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f381-695d-4574-9097-75d05a4ed7a7 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.627058 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.627648 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.627935 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.628192 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.628823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:58:57.629124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.630718 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.642597 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1402/2844] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:58:57.647063 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.656998 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158e41-ba9a-4eb9-829f-7edffa1893f6 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.662539 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.663047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.663261 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.663936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.664542 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.666335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.693197 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1443/2845] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:58:57 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:58:57.697392 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.708057 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b26a2-233a-4b77-a468-96b68eb52d81 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.727846 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:57.766018 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.766640 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.766927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.767203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.767823 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.769727 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.792664 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1403/2846] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:58:57 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:58:57.793996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.804092 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98a961-fe68-4dfb-b920-e3e8de1a58df admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.809096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.809674 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.809953 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.810218 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.810881 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.812447 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.823301 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1444/2847] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:57.826950 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.836825 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707cb07-9718-4a8b-a8ba-46e7486a9a30 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.841850 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c94e7d-c62f-4f60-bb83-7fbc96c23dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.842447 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c94e7d-c62f-4f60-bb83-7fbc96c23dae admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.842770 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c94e7d-c62f-4f60-bb83-7fbc96c23dae admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.843049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c94e7d-c62f-4f60-bb83-7fbc96c23dae admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.843711 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c94e7d-c62f-4f60-bb83-7fbc96c23dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.845308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c94e7d-c62f-4f60-bb83-7fbc96c23dae admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.858144 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1404/2848] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:57.862518 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:57.873952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b9339-19f0-4111-a124-b66b1d37b9d5 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:57.879335 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:57.880024 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.880305 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.880608 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] PATH_INFO: `/v3/projects/a8b29d18f45d4e65aeccef0762ee81c7/users/1b62266e9d9640508d4064a44a323d90/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.896708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b29d18f45d4e65aeccef0762ee81c7, user_id=1b62266e9d9640508d4064a44a323d90, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:57.899567 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:57.912978 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1445/2849] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:58:57 2022] PUT /identity/v3/projects/a8b29d18f45d4e65aeccef0762ee81c7/users/1b62266e9d9640508d4064a44a323d90/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:57.923277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:57.923571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:57.923852 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:57.952686 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] MFA Rules not processed for user `1b62266e9d9640508d4064a44a323d90`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:57.953896 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:58.017246 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1405/2850] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:58.028386 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:58.030030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:58.087185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed25c-acb0-4f7e-96fe-699560e0d027 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:58.090782 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd4377-b5b6-4377-8b59-7c1843ba76c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:58.091385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd4377-b5b6-4377-8b59-7c1843ba76c0 service cinder] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:58.092273 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd4377-b5b6-4377-8b59-7c1843ba76c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:58.092552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd4377-b5b6-4377-8b59-7c1843ba76c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:58.100995 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd4377-b5b6-4377-8b59-7c1843ba76c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:58.102432 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd4377-b5b6-4377-8b59-7c1843ba76c0 service cinder] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:58.112251 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1446/2851] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:05.753107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:05.754533 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:05.819326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634f1b0-f0fd-4426-bd6f-7d888cf9afa2 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:05.824292 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:05.824920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:05.825196 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:05.825464 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] PATH_INFO: `/v3/users/a44e166b292642bcb398a612feadd5ff` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:05.826576 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44e166b292642bcb398a612feadd5ff)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:05.828498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:05.864752 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:05.876102 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44e166b292642bcb398a612feadd5ff'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:05.882998 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44e166b292642bcb398a612feadd5ff'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:05.895508 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44e166b292642bcb398a612feadd5ff'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:05.902342 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44e166b292642bcb398a612feadd5ff'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:05.903016 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44e166b292642bcb398a612feadd5ff'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:05.908772 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1406/2852] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:59:05 2022] DELETE /identity/v3/users/a44e166b292642bcb398a612feadd5ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:59:05.913204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:05.913686 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:05.913794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:05.931962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:05.933668 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:05.950955 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:05.991818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1447/2853] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:06.001776 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:06.003187 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:06.065613 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e1a04-4de6-4a1a-81d2-ec11162fdaa0 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:06.069212 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:06.069811 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:06.070091 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:06.070363 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:06.079681 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:06.081082 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:06.090325 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1407/2854] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:06.347466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:06.349015 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:06.363690 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc44c2-26cb-4118-ad32-5f3208b405f5 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:06.368375 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:06.369004 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:06.369343 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:06.369534 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] PATH_INFO: `/v3/projects/0efc1735699c4aef91058b00afce0995` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:06.371235 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efc1735699c4aef91058b00afce0995)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:06.373147 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:06.418071 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efc1735699c4aef91058b00afce0995', 'request_id': 'req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:06.424253 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efc1735699c4aef91058b00afce0995', 'request_id': 'req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:06.431478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efc1735699c4aef91058b00afce0995', 'request_id': 'req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:06.442863 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] The token cache is being invalidate because project 0efc1735699c4aef91058b00afce0995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:59:06.443157 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:06.443779 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-fc0ea445-8a7d-47a2-bae4-0952ea71a1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:06.445223 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1448/2855] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:59:06 2022] DELETE /identity/v3/projects/0efc1735699c4aef91058b00afce0995 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:59:16.086222 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:16.439422 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:17.454504 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:17.455959 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:17.468622 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799720-8329-4b29-bcce-13f7d67f207c service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:17.523322 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:17.523946 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:17.524230 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:17.524507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] PATH_INFO: `/v3/users/1b62266e9d9640508d4064a44a323d90` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:17.525625 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b62266e9d9640508d4064a44a323d90)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:17.527572 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:17.574036 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b62266e9d9640508d4064a44a323d90'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:17.580457 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b62266e9d9640508d4064a44a323d90'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:17.591870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b62266e9d9640508d4064a44a323d90'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:17.598387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b62266e9d9640508d4064a44a323d90'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:17.599032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b62266e9d9640508d4064a44a323d90'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:17.604710 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1408/2856] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 11:59:17 2022] DELETE /identity/v3/users/1b62266e9d9640508d4064a44a323d90 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:59:17.609655 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:17.610133 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:17.610248 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:17.628936 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:17.630109 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:17.694311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1449/2857] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:17.703989 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:17.705381 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:17.761697 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319df32-a7a3-46c9-9547-467fb70ddd6d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:17.765521 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfb437-7c10-438a-8221-ce9f1eadfdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:17.766330 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb437-7c10-438a-8221-ce9f1eadfdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:17.766638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb437-7c10-438a-8221-ce9f1eadfdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:17.766920 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb437-7c10-438a-8221-ce9f1eadfdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:17.775863 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb437-7c10-438a-8221-ce9f1eadfdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:17.777277 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb437-7c10-438a-8221-ce9f1eadfdd3 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:17.786595 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1409/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:18.057557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.059180 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:18.076311 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0429-d5f2-4099-a94a-dd681b322358 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.081188 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.081818 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.082091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.082364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] PATH_INFO: `/v3/projects/a8b29d18f45d4e65aeccef0762ee81c7` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.083525 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b29d18f45d4e65aeccef0762ee81c7)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.085426 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.131376 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b29d18f45d4e65aeccef0762ee81c7', 'request_id': 'req-a63784a1-2304-4190-939a-15c097939e06'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:18.137478 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b29d18f45d4e65aeccef0762ee81c7', 'request_id': 'req-a63784a1-2304-4190-939a-15c097939e06'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:18.144487 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b29d18f45d4e65aeccef0762ee81c7', 'request_id': 'req-a63784a1-2304-4190-939a-15c097939e06'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:18.155123 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] The token cache is being invalidate because project a8b29d18f45d4e65aeccef0762ee81c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:59:18.155406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:18.156025 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-a63784a1-2304-4190-939a-15c097939e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:59:18.157481 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1450/2859] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 11:59:18 2022] DELETE /identity/v3/projects/a8b29d18f45d4e65aeccef0762ee81c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:59:18.162345 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.162652 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.162926 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.182431 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:18.183619 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:18.200071 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:18.243177 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1410/2860] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:18.252267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.252557 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.252839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.272688 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:18.273878 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:18.282524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1451/2861] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:18.286927 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.296473 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd668-e0f5-4818-b0b0-de993e9941ba None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.300938 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.301523 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.301802 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.302087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.302740 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:59:18.303041 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.304608 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.316027 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1411/2862] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 12 11:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:59:18.319993 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.329719 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26409-8fbd-4a48-9827-43b00f0bec19 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.334327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.335061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.335362 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.335636 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.336263 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.338153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.364731 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1452/2863] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:59:18 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:59:18.368716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.378436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dfb56-65b8-4fc7-ba3c-ec2b71584e69 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.433579 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.434107 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.434387 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.434690 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.435315 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.437216 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.457854 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1412/2864] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:59:18 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:59:18.462267 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.473086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b9c9-cdea-4f4a-b314-67e7f9190c5b admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.477622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.478204 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.478485 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.478790 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.479424 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.481048 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.490571 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1453/2865] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:59:18.494411 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.504656 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99943e47-08a9-4e0a-b02b-0b7ee2a094c9 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.509310 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab6670-ad8b-403f-9510-e58975b17fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.509902 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6670-ad8b-403f-9510-e58975b17fcf admin admin] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.510184 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6670-ad8b-403f-9510-e58975b17fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.510461 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6670-ad8b-403f-9510-e58975b17fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.511136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab6670-ad8b-403f-9510-e58975b17fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.513202 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab6670-ad8b-403f-9510-e58975b17fcf admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.523730 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1413/2866] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:59:18.528417 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.538096 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c753b-045e-483d-944f-ac475f3aae47 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.542677 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.543312 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.543592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.543866 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] PATH_INFO: `/v3/projects/45a982b3e219420fb17c07b591042992/users/bd3289f4fa7745ceb12f4d5cd7f901c6/roles/ae415c84706a4f84a2ec0503e561cc73` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.558552 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a982b3e219420fb17c07b591042992, user_id=bd3289f4fa7745ceb12f4d5cd7f901c6, role_id=ae415c84706a4f84a2ec0503e561cc73)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.561239 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.575115 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1454/2867] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:59:18 2022] PUT /identity/v3/projects/45a982b3e219420fb17c07b591042992/users/bd3289f4fa7745ceb12f4d5cd7f901c6/roles/ae415c84706a4f84a2ec0503e561cc73 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:59:18.580076 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02dcc0-581c-41a4-b821-a2107e4d2eec None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.580366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02dcc0-581c-41a4-b821-a2107e4d2eec None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.580666 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02dcc0-581c-41a4-b821-a2107e4d2eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.599728 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-0e02dcc0-581c-41a4-b821-a2107e4d2eec None None] MFA Rules not processed for user `1a0b7676c79e47efbad45a84392bc86a`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:18.600921 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0e02dcc0-581c-41a4-b821-a2107e4d2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:18.658857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1414/2868] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:18.668704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:18.670466 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:18.692472 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:18.728393 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f709de-87f0-49b8-b8d0-159eccb70b6d admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:18.731996 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:18.732592 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:18.732874 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:18.733151 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:18.741825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:18.743287 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:18.752968 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1455/2869] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:22.626410 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:22.626990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:22.626990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:22.658762 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.auth.core [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] MFA Rules not processed for user `bd3289f4fa7745ceb12f4d5cd7f901c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:22.660140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:22.679231 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:22.738749 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1415/2870] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:22.741931 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:22.753149 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b952f-500d-491d-9260-4333999e92c7 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:22.758452 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:22.759468 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:22.759810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:22.760250 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:22.760983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:22.763031 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:22.796234 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1456/2871] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 12 11:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:59:22.797248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:22.812356 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eff57-e5e0-4c69-bca9-b21fee013b10 None None] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:22.873720 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:22.874343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:22.874669 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:22.874947 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:22.875574 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:22.877663 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:22.899008 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1416/2872] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 12 11:59:22 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:59:22.903170 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:22.913294 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb873df-a6b3-4a8e-a172-a32ce85d1ccb admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:22.918291 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:22.918917 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:22.919192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:22.919459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:22.920086 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:22.921665 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:22.931830 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1457/2873] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:59:22.936496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:22.946575 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907698b4-3aa9-4654-87d4-1707346fd7c1 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:22.951412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:22.952056 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:22.952338 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:22.952615 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] PATH_INFO: `/v3/projects/7634d127b6354741bfeb16b3474c36d6/users/1739efca18784861a96a06eefa15c3bb/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:22.967015 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7634d127b6354741bfeb16b3474c36d6, user_id=1739efca18784861a96a06eefa15c3bb, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:22.969589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:22.983124 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1417/2874] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:59:22 2022] PUT /identity/v3/projects/7634d127b6354741bfeb16b3474c36d6/users/1739efca18784861a96a06eefa15c3bb/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:59:22.986796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:22.997419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3797b4-7905-4c26-9192-e249098d1479 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:23.052061 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff28e5-7c69-4d76-b174-ba743fb6563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:23.052673 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff28e5-7c69-4d76-b174-ba743fb6563b admin admin] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:23.053005 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff28e5-7c69-4d76-b174-ba743fb6563b admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:23.053281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff28e5-7c69-4d76-b174-ba743fb6563b admin admin] PATH_INFO: `/v3/roles` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:23.053949 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff28e5-7c69-4d76-b174-ba743fb6563b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:23.056221 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff28e5-7c69-4d76-b174-ba743fb6563b admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:23.067172 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1458/2875] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 12 11:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:59:23.071771 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:23.082085 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75b2b8-704d-4a19-8bbc-e99eac93e6fd admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:23.086787 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:23.087430 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:23.087714 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:23.087990 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] PATH_INFO: `/v3/projects/7634d127b6354741bfeb16b3474c36d6/users/1739efca18784861a96a06eefa15c3bb/roles/18025b295a624a3cb873b1f75c4f73a4` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:23.089908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7634d127b6354741bfeb16b3474c36d6, user_id=1739efca18784861a96a06eefa15c3bb, role_id=18025b295a624a3cb873b1f75c4f73a4)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:23.092581 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:23.102751 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1418/2876] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 12 11:59:23 2022] PUT /identity/v3/projects/7634d127b6354741bfeb16b3474c36d6/users/1739efca18784861a96a06eefa15c3bb/roles/18025b295a624a3cb873b1f75c4f73a4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:59:27.268906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84075ca-32e3-4e11-ba25-045a10a79b90 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:27.269415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84075ca-32e3-4e11-ba25-045a10a79b90 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:27.269415 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84075ca-32e3-4e11-ba25-045a10a79b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:27.298753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-a84075ca-32e3-4e11-ba25-045a10a79b90 None None] MFA Rules not processed for user `1739efca18784861a96a06eefa15c3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:27.299983 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a84075ca-32e3-4e11-ba25-045a10a79b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:27.387384 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1459/2877] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:27.403376 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:27.405964 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:27.502788 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d669e3-b7a5-4688-b3b2-5def018626e1 admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:27.518281 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:27.519047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:27.519389 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:27.519848 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:27.526170 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:27.599161 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:27.601047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:27.611502 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1419/2878] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:37.383443 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:37.606940 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=24 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:45.146215 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:45.146726 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:45.146951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:45.165206 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] MFA Rules not processed for user `bd3289f4fa7745ceb12f4d5cd7f901c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:59:45.166378 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:45.173590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1460/2879] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:59:45.212916 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:45.214350 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:45.270001 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec216d-2226-4324-ae14-126d365ae8e9 service nova] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:45.273534 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76127525ce2e45a3b53487d0f92014ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:45.274136 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:45.274417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:45.274719 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:45.276383 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:45.289388 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:45.290836 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:45.302155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1420/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:46.020702 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:59:46.076753 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d959-901a-4453-9e0a-069f5a3f8afb None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:59:46.080737 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:59:46.081341 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:59:46.081621 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:59:46.081891 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:59:46.083660 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:59:46.098986 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:59:46.100704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:59:46.111622 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1461/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:59:55.296824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=26 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:56.106581 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=29 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:00.648122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:00.659219 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229216ce-d517-40e7-a543-756048c92d50 service cinder] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:00.662814 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:00.663408 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:00.663687 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:00.663958 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:00.672905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:00.675108 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:00.684313 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1421/2882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:10.680320 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=6 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:56.340333 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:56.349356 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1420d1-a955-4444-8629-a1176b53c150 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:56.352907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:56.353486 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:56.353758 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:56.354026 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:56.355792 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:56.365588 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:56.367047 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:56.374990 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1462/2883] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:01:06.371270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=6 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:07.427872 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:01:07.436390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60ed86-149e-4c8c-8b83-efc481e2541b service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:01:07.439963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:01:07.440553 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:01:07.440832 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:01:07.441355 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:01:07.443087 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:01:07.452905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:01:07.455153 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:01:07.463813 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1422/2884] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:01:08.574159 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:01:08.575616 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:01:08.586489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764f90-f92d-44cc-9bca-c4aa40cc3153 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:01:08.590053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:01:08.590669 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:01:08.590951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:01:08.591226 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:01:08.592859 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:01:08.606078 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:01:08.607585 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:01:08.619272 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1463/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:01:08.688877 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:01:08.690300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:01:08.759978 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31b49-5a8e-4879-918b-3b5cfa9e5580 service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:01:08.765134 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:01:08.765773 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:01:08.766049 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:01:08.766319 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:01:08.768841 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:01:08.780199 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:01:08.781743 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:01:08.791415 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1423/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:01:09.166573 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:01:09.180812 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153bdc-3b15-4574-8803-9385b724bec5 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:01:09.186284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:01:09.186906 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:01:09.187185 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:01:09.187457 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:01:09.189778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:01:09.202437 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:01:09.204289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b79ee4-fd46-4479-b0b8-f5297b9e04a7 service nova] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:01:09.214860 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1464/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:01:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:01:18.787248 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=38 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:19.210156 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=12 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:02.859390 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:02.861496 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:02.880933 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8292-6427-46e8-ba66-d6aae715dc1d service placement] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:02.886424 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b3bee55e837447180812b0f2bb2abd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:02.887155 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:02.887445 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:02.887732 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:02.889477 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:02.903655 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:02.905227 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:02.918159 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1424/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:04.638695 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c696d-761a-4502-8599-e55f1330c572 None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:04.639175 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c696d-761a-4502-8599-e55f1330c572 None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:04.639281 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c696d-761a-4502-8599-e55f1330c572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:04.658575 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-783c696d-761a-4502-8599-e55f1330c572 None None] MFA Rules not processed for user `bd3289f4fa7745ceb12f4d5cd7f901c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:04.659810 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-783c696d-761a-4502-8599-e55f1330c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:04.666492 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1465/2889] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 12:02:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:04.978977 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:04.988269 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd276c-7fd8-476f-90c7-f9d18def348f service nova] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:04.991824 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:04.992412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:04.992694 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:04.992968 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:04.994675 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:05.004436 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:05.005840 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:05.013701 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1425/2890] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:14.653153 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=3 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:15.010083 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=12 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:46.215319 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c696d-761a-4502-8599-e55f1330c572 None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:46.225013 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c696d-761a-4502-8599-e55f1330c572 None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:46.228554 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:46.229150 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:46.229429 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:46.229704 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:46.231459 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:46.292935 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:46.294368 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:46.303595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1466/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:49.282594 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:49.284059 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:49.298507 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65003-610c-413b-a821-ecbabefafe1b service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:49.303441 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:49.304037 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:49.304314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:49.304582 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:49.306235 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:49.320198 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:49.322944 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:49.339563 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1426/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:52.116438 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:52.129644 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa23b2-c91d-43b7-a869-02ab51106e42 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:52.135778 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:52.136663 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:52.136942 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:52.137373 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:52.139435 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:52.152769 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:52.154397 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:52.171200 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:52.172687 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1467/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:52.172782 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:52.201458 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b6066-b2e2-4fb7-91cb-97e9320142bc service placement] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:52.207045 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:52.207623 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:52.207908 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:52.213204 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] PATH_INFO: `/v3/users/4974aee8a8724bcd8278cd1fc8736b05` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:52.214829 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4974aee8a8724bcd8278cd1fc8736b05)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:52.216838 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:52.262308 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4974aee8a8724bcd8278cd1fc8736b05'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.270704 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4974aee8a8724bcd8278cd1fc8736b05'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.282893 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4974aee8a8724bcd8278cd1fc8736b05'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.289858 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4974aee8a8724bcd8278cd1fc8736b05'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.290497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4974aee8a8724bcd8278cd1fc8736b05'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.296418 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1427/2894] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:52 2022] DELETE /identity/v3/users/4974aee8a8724bcd8278cd1fc8736b05 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:52.482091 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:52.492711 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61179-5d3d-49f9-b181-891d9966a6b0 service placement] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:52.550925 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:52.551549 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:52.551825 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:52.552099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] PATH_INFO: `/v3/projects/42c8262170e04920ae36e89e24656f7d` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:52.553199 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c8262170e04920ae36e89e24656f7d)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:52.555126 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:52.601270 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c8262170e04920ae36e89e24656f7d', 'request_id': 'req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.607265 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c8262170e04920ae36e89e24656f7d', 'request_id': 'req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.614395 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c8262170e04920ae36e89e24656f7d', 'request_id': 'req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.625419 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] The token cache is being invalidate because project 42c8262170e04920ae36e89e24656f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:52.625708 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.626364 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.627843 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1468/2895] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:52 2022] DELETE /identity/v3/projects/42c8262170e04920ae36e89e24656f7d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:52.631925 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:52.633343 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:52.646537 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9f53-2f83-4f53-a9e4-6a10168dc5cb admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:52.703497 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:52.704140 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:52.704425 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:52.704705 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] PATH_INFO: `/v3/users/6cc8bd3a79524b5f987e914eaf49af6b` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:52.705865 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc8bd3a79524b5f987e914eaf49af6b)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:52.707844 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:52.753434 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc8bd3a79524b5f987e914eaf49af6b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.760996 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc8bd3a79524b5f987e914eaf49af6b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.766454 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:52.775845 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc8bd3a79524b5f987e914eaf49af6b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.786758 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc8bd3a79524b5f987e914eaf49af6b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.787494 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc8bd3a79524b5f987e914eaf49af6b'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:52.793489 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1428/2896] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:52 2022] DELETE /identity/v3/users/6cc8bd3a79524b5f987e914eaf49af6b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:52.965101 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:52.966952 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:52.980574 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4ad3-d2e7-410c-a60f-2aaa9a9498af admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:52.989076 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:53.039587 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:53.040213 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:53.040489 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:53.040755 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] PATH_INFO: `/v3/projects/80706aa8833543f4ba57e7199a9dd850` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:53.041839 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80706aa8833543f4ba57e7199a9dd850)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:53.043764 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:53.088994 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80706aa8833543f4ba57e7199a9dd850', 'request_id': 'req-314af22b-dd6b-4b57-b316-26b590a8279d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:53.095593 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80706aa8833543f4ba57e7199a9dd850', 'request_id': 'req-314af22b-dd6b-4b57-b316-26b590a8279d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:53.103169 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80706aa8833543f4ba57e7199a9dd850', 'request_id': 'req-314af22b-dd6b-4b57-b316-26b590a8279d'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:53.114099 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] The token cache is being invalidate because project 80706aa8833543f4ba57e7199a9dd850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:53.114385 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:53.115032 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-314af22b-dd6b-4b57-b316-26b590a8279d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:53.116508 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1469/2897] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:52 2022] DELETE /identity/v3/projects/80706aa8833543f4ba57e7199a9dd850 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:00.646584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.648020 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.716128 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d00d-3739-4105-91df-9bb732e4d89d admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.775122 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.775741 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.776025 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.776301 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.778014 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.789029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.790589 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.800816 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1429/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:03.111053 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:10.796412 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=67,keystone:DELETE=1 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:00.952257 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] REQUEST_METHOD: `POST` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.952855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.952855 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.972720 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.auth.core [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] MFA Rules not processed for user `bd3289f4fa7745ceb12f4d5cd7f901c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:00.973951 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.036295 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1470/2899] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 12 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:01.367636 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.369047 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.427112 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9217-100d-47be-8f72-3d279c5edc7e service placement] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.430642 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.431241 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.431517 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.431784 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.433488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.443033 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.444515 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.452417 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1430/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:11.024916 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=25 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:11.448761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=26 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:47.855883 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:47.865517 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61c5b6-014d-49e7-8e76-cab3187593da None None] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:47.869666 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:47.870259 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:47.870532 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:47.870824 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:47.873570 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:47.885763 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:47.887284 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:47.897030 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1471/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:48.925857 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:48.935905 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215f159-67a9-4b43-ae0e-2101371f867f service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:48.940101 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:48.941044 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:48.941326 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:48.941638 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:48.943498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:49.019261 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:49.020689 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:49.032203 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1431/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:50.220519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:50.229012 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af51c22-ed6f-4b20-ae4c-3f340c1afa3e service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:50.232649 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:50.233247 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:50.233524 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:50.233796 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:50.235509 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:50.249041 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:50.250453 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:50.261815 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1472/2903] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:55.964602 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:55.974963 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ddb51-9ea6-42f3-913f-33c16dce8bde service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:55.980300 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:55.980994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:55.981358 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:55.981716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:55.983736 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:55.995118 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:55.996584 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:56.007017 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1432/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:06:00.256289 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=12 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:01.427127 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:01.436416 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7a0c-b550-4a5a-83bf-6a5ffd1f11d1 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:01.440083 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209260a51d244372a392acf3176e8303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:01.440929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:01.441210 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:01.441473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:01.443519 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:01.505926 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:01.507330 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:01.516590 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1473/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:06:06.003798 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=40 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:07.384723 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:07.386220 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:07.401634 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1763-da99-49a5-b96c-8309fc11d9df service neutron] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:07.406289 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:07.406994 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:07.407295 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:07.407571 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] PATH_INFO: `/v3/users/bd3289f4fa7745ceb12f4d5cd7f901c6` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:07.408716 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3289f4fa7745ceb12f4d5cd7f901c6)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:07.410713 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:07.462506 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3289f4fa7745ceb12f4d5cd7f901c6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.470284 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3289f4fa7745ceb12f4d5cd7f901c6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.483779 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3289f4fa7745ceb12f4d5cd7f901c6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.491206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3289f4fa7745ceb12f4d5cd7f901c6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.492029 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3289f4fa7745ceb12f4d5cd7f901c6'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.502061 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1433/2906] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 12:06:07 2022] DELETE /identity/v3/users/bd3289f4fa7745ceb12f4d5cd7f901c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:06:07.683946 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:07.696192 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab698-81d9-4035-b54b-7a8a1524c1c2 service neutron] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:07.763327 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:07.764066 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:07.764406 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:07.764888 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] PATH_INFO: `/v3/projects/45a982b3e219420fb17c07b591042992` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:07.766033 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a982b3e219420fb17c07b591042992)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:07.767977 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:07.815425 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a982b3e219420fb17c07b591042992', 'request_id': 'req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.822401 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a982b3e219420fb17c07b591042992', 'request_id': 'req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.830315 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a982b3e219420fb17c07b591042992', 'request_id': 'req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.841564 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] The token cache is being invalidate because project 45a982b3e219420fb17c07b591042992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:06:07.841851 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.842476 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.844072 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1474/2907] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 12:06:07 2022] DELETE /identity/v3/projects/45a982b3e219420fb17c07b591042992 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:06:07.848055 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:07.849498 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:07.863384 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dac0f-1189-44fa-b401-c4993e792e0c admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:07.927570 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:07.928206 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:07.928488 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:07.928761 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] PATH_INFO: `/v3/users/1739efca18784861a96a06eefa15c3bb` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:07.929874 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1739efca18784861a96a06eefa15c3bb)` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:07.931827 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:07.977831 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1739efca18784861a96a06eefa15c3bb'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.985973 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1739efca18784861a96a06eefa15c3bb'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:07.998302 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1739efca18784861a96a06eefa15c3bb'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.000314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:08.007094 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1739efca18784861a96a06eefa15c3bb'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.008422 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.notifications [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1739efca18784861a96a06eefa15c3bb'} {{(pid=93181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.014753 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1434/2908] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 12 12:06:07 2022] DELETE /identity/v3/users/1739efca18784861a96a06eefa15c3bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:06:08.197495 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Authenticating user token {{(pid=93182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:08.199799 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.fernet_utils [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:08.216023 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0c97-8a33-43d2-85e1-e6f0d68bd5c9 admin admin] Validating token access rules against request {{(pid=93182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:08.237912 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:08.278595 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a0b7676c79e47efbad45a84392bc86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb962a2585ab4e27ac665ceb80fa0708', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:08.279252 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:08.279530 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:08.279828 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] PATH_INFO: `/v3/projects/7634d127b6354741bfeb16b3474c36d6` {{(pid=93182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:08.280929 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7634d127b6354741bfeb16b3474c36d6)` {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:08.282887 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] RBAC: Authorization granted {{(pid=93182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:08.327656 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7634d127b6354741bfeb16b3474c36d6', 'request_id': 'req-f2022093-d51f-4dc1-9af9-672696c332b0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.333473 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7634d127b6354741bfeb16b3474c36d6', 'request_id': 'req-f2022093-d51f-4dc1-9af9-672696c332b0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.340794 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7634d127b6354741bfeb16b3474c36d6', 'request_id': 'req-f2022093-d51f-4dc1-9af9-672696c332b0'} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.350962 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] The token cache is being invalidate because project 7634d127b6354741bfeb16b3474c36d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:06:08.351276 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.351899 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG keystone.notifications [None req-f2022093-d51f-4dc1-9af9-672696c332b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:08.353369 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: [pid: 93182|app: 0|req: 1475/2909] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 12 12:06:08 2022] DELETE /identity/v3/projects/7634d127b6354741bfeb16b3474c36d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:06:18.011218 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=4 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:18.347907 dv-cinder-852828-2-iscsi devstack@keystone.service[93182]: DEBUG dbcounter [-] [93182] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:08.575870 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Authenticating user token {{(pid=93181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:08.577314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:08.713737 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dbce4-ae95-480b-8943-866de6fb78ed admin admin] Validating token access rules against request {{(pid=93181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:08.770397 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f00cae3d04d2fa79ed4481ce024aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e67f8f820364780aba886ef5fdcf891', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:08.771032 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] REQUEST_METHOD: `GET` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:08.771314 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] SCRIPT_NAME: `/identity` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:08.771590 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:08.773329 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.fernet_utils [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:08.784804 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:08.786366 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173cb2-9dfa-444d-8870-0ab2c11b7a59 service placement] RBAC: Authorization granted {{(pid=93181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:08.796683 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: [pid: 93181|app: 0|req: 1435/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:18.792750 dv-cinder-852828-2-iscsi devstack@keystone.service[93181]: DEBUG dbcounter [-] [93181] Writing DB stats keystone:SELECT=89 {{(pid=93181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}